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ABSTRACT 


A computer processing technique is advanced which seeks 
to retain or improve data information context while reducing 
the dimensionality of data representation. Defining 
information context as the relative proximity of data 
points, a nonlinear transformation is analytically derived 
τ Utilizes Euclidean distance to one or more reference 
points to provide a measure of similarity between data 
points. The nonarbitrary reference points are selectively 
manipulated to provide, given certain contraints, a unique 
mapping from high dimensional space to one or more 
dimensions for each point in space. The transformation 
process enhances class clustering and interclass separation 
in the lower dimensional representation. 

Computer processed experimental results are presented of 
reduction from 32, 10, and 3 space into 2 space for Doth 
synthetic and real world data. Utilizing a ratio of 
intraclass variance to interclass variance as a figure of 
merit and as one possible optimization criterion, this 
technique yielded a significant ratio improvement in mapping 
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I. INTRODUCTION 


"In the widest sense, patterns are the means by which we 
interpret the world. 


WILLIAM S. MIESEL 


Data becomes meaningful information when it provides a 
perspective on known information. In its most general sense, 
the context of unknown information is judged by its 
relationship to known information. The most numerous pattern 
recognition mechanism on the planet Earth, man, primarily 
judges the meaning of new information on his past 
experiences. He interprets his senses relative to his 
personal environment and experiences. However, the methods 
by which man preceives new experiences relative to past 
experiences is not yet fully understood. 

Mathematical pattern recognition, using digital 
computers, attempts to emulate the humans skill at pattern 
recognition, albeit poorly, by relating new information to 
its own data base of accumulated information. The computer 
has the advantage of performing vattern recognition in high 


dimensional spaces, spaces incomprehensible to mar. 


A. MOTIVATION 
Pattern recognition represents information as numerical 
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values. In supervised learning, numerical representatlons of? 
Known objects are compared against numerical representations 
of unknown objects in an attempt to recognize the 712 
object. The complexity of analysis rapidly increases as more 
and more measures of an object are collected. Each measure 
is, in numerical form, a descriptor of some attribute of an 
item, be it a physical object, an event in time, or some 
metaphysical relationship. The number of measures of a item 
of data define the number of dimensions in space in which 
the item exists. A sample of ar object is defined to be one 
set of measurements of that object. The complexity of 
evaluating the meaning or identity of an sample increases 
exponentially as the number of dimensions in which the 
object is described. The fact that procedures which are 
analytically or computationally manageable in low dimensions 
become completely impractical with high dimensional 
representations is termed within the pattern recognition 
literature as the curse of dimensionality [1,2,3]. 

The significance of information is που ھ1‎ its 
representation but in its context. In classifying data 
relative to known information the concern is recognition, 
not representation. The premise of this research is that a 
transformation exist which will overcome, to some extent, 
the curse of dimensionality by reducing informatior 
representation while retaining context. Viewed 


geometrically, this transformation will attempt to retain or 
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enhance relative proximity of similiar information and 
separate the relative proximity between different 
information sources while reducing the number of dimensions 


in the representation. 


B. A RELATIVE PROXIMITY SCENARIO 


Consider the problem of? an aircraft navigator equivped 
with a range only measuring device. The navigator knows the 
general location of his aircraft but would like to precisely 
fix his position. In doing so, he measures the distance to 
two landmarks conveniently available to him as in figure 
1.1. He then circumscribes a cirle around each of the 
landmarks ,each with a radius equal to the distance from the 
aircraft to that landmark. Unless he is exactly on the line 
drawn between the two references points the circles drawn 
will intersect at two points. By knowing his general 
position, that is, by knowing the aircraft’s position 
yelative to that line, the nagivator can resolve the 
ambiguity and select the correct intersection as his 
position. 

This example, greatly generalized and viewed from the 
perspective of the landmarks rather than the navigator, is 
the transformation developed in this thesis to reduce 
representation while retaining relative proximity of 


Similiar information. 
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Figure 1.1 Aircraft position determined relative to two 


reference points. 
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E SCOPE 


The generalized pattern recognition process is described 
to provide insight into the role of dimensionality 
reduction. Next the nonlinear transformation employed to 
reduce data representation is analytically derived. This is 
followed by geometric illustrations of the Transformation 
ard a rationalization of its effects on class clustering. 
Results of specific test cases are described and graphically 
illustrated. The final chapter provides conclusions, 
recommendations for applications, and further research areas 


in this methodology. 
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II. THE PATTERN RECOGNITION PROCESS 


A. NATURE OF TEE PROCESS 


"Pattern classification is the assignment of a physical 
object or event to one of several prespecified catagories 
"[1]. The act of making that assignment can be characterized 
by three sequential logical component processes as shown in 
figure 2.1. Ir the first process, the physical world is 
sensed by some transducer system which transforms data into 
a machine processible state. The transducer changes the 
physical reality of an object, characterized as a continuum 
of parameters and infinite in dimensionality, into a pattern 
Space whose domain is defined by the discretization of 
sensor data observed in the real world. This discrete set of 
measurements finitely bounds the range of values and number 
of dimensions which characterize the object. Feature space 
15 an intermediate domain between pattern space and 
classification space. There may be one or more subprocesses 
required in transforming pattern space into feature space. 
This transformation into feature space is the process, 
termed feature selection, preprocessing, or feature 
extraction, by which a Sample representation in pattern 
Space is described by a finite and usually smaller sample 


representation called features. Feature space is a reduced 
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FIGURE 2.1 The pattern recognition process 
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representation which attempts to retain as much 
discriminating power as possible while removing as much 
redundancy as possible. The transformation from feature 
Space to classification space is accomplished via a set of 
decision rules which classify an unlabeled (unknown) sample 
of an object as a member of one of the known data sets. The 
classification problem is basically one of partitioning the 
feature space into regions, one region for each category. 
The view of pattern recognition as a series of processes was 
provided by H. C. Andrews[3]. Meisel [2] views pattern 
recognition as a series of states in which the data exist. 


The two perspectives are logically equivalent. 


B. DIMENSIONALITY REDUCTION 


In describing the dimensionality reduction inherent in 


feature extraction Duda and Hart comment : 


There is a growing body of theory of dimensionality 
peduction for pattern classification. Some of these 
methods seek to form new features out of linear 
combinations of old ones. Others seek merely a small 
subset of the original features. A major problem 
confronting this theory is that the division of pattern 
recognition into feature extraction followed by 
classification is theoretically artificial. A completely 
Optimal feature extractor can never be anything but an 
optimal classifier. [1] 


Andrews states : 


While the objective in defining the feature space 15 to 
reduce the dimensionality of the pattern space yet 
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maintaining discriminatory power for classifiction 
purposes, successful transformations still seem in their 
infancy. There exist a variety of linear transformations 
as well as Some nonlinear methods which are developing 
particular appeal but the real frontiers of pattern 
recognition still lie ahead in developing a viable 
feature selection transformation that undoes the 
redundant data gathering inherent in the definition of 
pattern space. [3] 

The variety of feature extraction techniques are too 
numerous to mention individually, but can be discussed as 
families of methodologies. Principal component analysis 
techniques attempt to maintain discrimination while reducing 
the dimensionality of data representation by selecting a 
subset of measurements from pattern space which contain the 
most variability. The objective of factor analysis is to 
find a lower dimensional representation that accourts for 
the correlations among the features. The multidimensional 
scaling technique reduces the dimensionality while 
attempting to maintain the distance relationships between 
all points in pattern space in feature space. This feature 
extractor iteratively processes the data until a minimum 
error exists in the feature space representation of pattern 
space distance relationships. Classical discriminant 
analysis attempts to find a lower dimensional surface on 
which to project the data samples and achieve good 
separation between classes. In @ach case the methodologies 


incur some loss of information in feature extraction. 


The intrinsic meaning of the data points, not their 
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representation, is their single most important property. 8 
optimal feature extractor must not lose context while 
reducing data representation. Certainily, any feature 
extractor which reduces the context while reducing the 
representation is suboptimal. Yet the term feature extractor 
itself implies retaining some information while discarding 
some information. Perhaps a change of perspective is 
required to better reduce data representations. Consider a 
method of representing in a lower dimension the 
relationships between data samples in pattern space rather 
than the data itself. The relationships are the significant 
factors, not the representations, for they define the 
context of the information. 

The relationships between data points are typically 
judged in terms of distance measures. Meisel astutely noted 
"distance is crucial in pattern recognitions it is assumed, 
roughly, that the closer a point is to another point, the 
more similar are the patterns represented by those 
points .(2] Multidimensional scaling capitalizes on this 
fact by attemptirg to retain pattern space distance 
relationships in feature space. Yet it fails to do so 
completely since the distance relationships between all 
points can not be explicitly retained in any less than the 
number of pattern space dimensions unless the points exist 
in a subspace within the pattern space. 


Again recall that the significant factor is context, not 
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representation. Taking the liberty of paraphasing Meisel’s 
words, the greater the relative proximity of one point to 
another point, the greater the similarity of the patterns 
represented by those points. If, in reducing the data 
representation dimensionality, the relative proximity of 
similar information is maintained then it seems intiutive 
that little loss of 00 71 has occured in the 
transformation. Multidimensional scaling severly constraints 
itself by attempting to maintain distance relationships in 
lower dimensions. The transformation presented here will 
forego maintaining distance relationships between all points 
in lieu of maintaining relative proximity betweer similar 


data points. ' 


C. GENERAL APPROACH TO A RELATIVE PROXIMITY TRANSFORMATION 


In developing this nonlinear transformation use is made 


of two axioms : 


1. the distance between two points in n dimensional space 


is a scalar value; 


2. an n dimensional lattice space is relatively sparse 


compared to n dimensional continuous space. 


These facts are of vital signifinance in the ability to 
reduce representation without loss of context. 


The distance from one point to another point is a 
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measure of the relative proximity of the points. In one 
dimension, the similarity or lack of similarity in distance 
from a reference point to all other points in effect defines 
each point’s relative proximity to one another. By 
generalizing to n dimensions and constraining the data space 
to remove ambiguity, the context of points in n dimensions 
may be measured by their similarity in distance to one or 
more Known reference points. 

The selection of reference points will be based on a 
criterion of retaining, if not improving, relative proximity 
of similar representations, separating dissimilar 
representations, and providing a unique mapping from n 
dimensional pattern space to an m (m » 1) dimensional 


feature space. 
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III. N-DIMENSIONAL NONLINEAR TRANSFORMATIONS 


This chapter considers the representation of known data 
samples in pattern space. Their representations in pattern 
Space produce several constraints and assumptions about that 
Space which allow nonlinear transformations to reduce the 
dimensionality of their representations. In subsequent 
chapters it will be shown that the reduced representation 
retains or, more likely, improves any clustering presert in 
samples of the same object. This implies that the 
information context of the reduced representation is at 
least maintained if not improved in the lower dimension 
representation. The case of a two dimensional pattern space 
to two dimensional distance space transform is first 
developed, followed by a three dimensional pattern space to 
two dimensional distance space transformation. A discussion 
of n dimensional to m dimensional transforms corclude the 


chapter. 


A. DEFINITIONS 


Let X, = (Ej or لق‎ be the i th sample vector 
in pattern space describing an object where 
x; (j = 1,n) is a real number; 


n is the firite number of dimersions in 
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the sample vector. 


Let D, = (d,.,d..,.-.,d .( be the ordered representation of 
1 01 mi 


21 
the i th sample in distance space? where 
m is the finite number of dimensions in 
the distance vector. 
d, (k =1,m) 15 a real number 
where (d, ) is the Euclidean distance 
from a designated reference point (Rg) 
to a sample point (X ); 
The Euclidean distance (à, ) is defined to have the following 
properties for any three distinct points κ σα i £j 
d(xi,x4) - ri -- De ee d(xi x5) > 0 
d(x, ,x,) = @ d(xi,xj4 ) = d(x;,x;) 
d (x, x.) * ix. x) > d(x sx) 
A nonlinear transformation (T) is defined such that 


T: (X ---»D ) 
ae 1 


B. TRANSFORMATION FROM TWO DIMENSIONAL PATTERN SPACE INTO 
TWO DIMENSIONAL DISTANCE SPACE 


In considering the two dimensional transformation (T) 
recall the example of the navigator. In that situation, the 


navigator knew the aircraft’s approximate position, 


I me term distance space is utilized in lieu of feature 
space since the features are distances from reference points 
rather than a subset of measurements from pattern space as 
might be done , for example, in principal component 
anaylsis. 
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effectively limiting the area in which he could be precisely 
located. In the general case in two dimensions one method to 
locate a point in space precisely is to constrain that point 
to a certain region as in the case of the navigator. In 
constraining a point to remove ambiguity two factors enter 
into consideration. In supervised learning an attempt is 
made to identify an object solely on its proximity to other 
identified points. The range of values of the known objects 
are precisely defined and the unknown sample values will be 
approximately equal to the known values. Secondly, recall 
that the navigator had to know his general position relative 
to a line drawn between the two reference points to resolve 
the ambiguity in choosing which of the two intersections was 
his position. Knowing the approximate range of values allows 
selection of a constant scaling factor whlch will scale all 
points into nonnegative space. By scaling the data to be 
nonnegative most ambiguity is removed as all intersections 
occuring outside nonnegative space can be rejected, as in 
figure 3.1a. 

To remove any ambiguity caused by both intersections 
occuring within the constrainted pattern space restrictions 


are placed on reference points R, and ۰ For computational 


1 


simplicity reference point one (R, ) is defined as the 
origin. A valid reference point two (R, ) is defined such 


that one and only one intersection will occur within pattern 
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Figure 3.la A two dimensional representation of a valid 


reference point two. 





constrainted 
pattern 


original 
pattern 
Space 


This reference point two is valid for this situation 
in that only one point of intersection lies within 


constrainted pattern space. 
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nce ^. The values of valid reference point twos (8) are 
generally not bounded and are infinite in number even with 
the uniqueness constraint. The distance from each reference 
point to a point in the pattern space lattice defines the 
radius of a circle. The intersection of the circles about 
each of the reference points defines a point in space. 
Figure 5.14 illustrates the case of a valid R and Ea Note 
that of the two intersections defined by the circles only 
one exist in constrainted pattern space. Figure STD 
demonstrates an invalid ἃ, in that two points of 
intersection exist in constrainted pattern space. 

The two dimensional pattern space into two dimensional 


distance space transformation may be stated in the following 


manner ο 


Given a set of samples Y, = (Ψ11 1121) , (i = 1,number of 
samples) 


in pattern space where 


KT FE Ca; (j = the) 


BE! is the maximum value which the 
1 th element may assume; 

k is a scale factor such that the 
minimum value of Yai O 


2 

From this point forward in the discussion, the term pattern 
space implies a nonnegative, maximally bounded pattern 
Space. 
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Figure 3.158 A two dimensional representation of an 


invalid reference point two. 


constrainted 
pattern 
space 





Ambiguity exists as there are two points of intersection 


detined within constrainted pattern space. 
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5 
= (x1;5,x5,),(1 = 1,number of samples) 
is the set of samples in 
constrainted pattern space 
there exist a set of samples D (d1i,d5i) in distance 


Space obtained through the nonlinear transformation 
ie: ( LES =< DE ) 
where 
2 3547 
dji F σαι” Γη) ] (j =1,2),(i = 1,numbder of 
samples) is the Zuclidean distance 


function as defined above {2.1} 


R4 (0,9) 
Ro = ( ppp») is a valid reference point. 
A reference point two is valid for two space if and only if 
there exist one and only one solution within pattern svace 


to the simultaneous equations defining (dj) ard (d5) for all 


points in pattern space. 


C. TRANSFORMATION FROM THREE DIMENSIONAL PATTERN SPACE 
INTO TWO DIMENSIONAL DISTANCE SPACE 


Observe in figure 3.2 the radii (d4,,d5) computed as the 
distance from 3 reference point to a sample point 
geometrically describe spheres in three dimensions. The 
intersection of the two spheres formed, respectively, of the 


radii d,d) from Rı,R, defines a circle in two dimensions. 
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The circle of intersection ἢ 
contains only one lattice 
point of the constrainted 
pattern space. 


constrainted 
pattern 
Space 
١ 8 
١ 


lattice 


point 
circle of 
tersection 


M 





Figure 3.2 A three dimensional valid reference polnt 


two 9 
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In continuous space all polnts on the circle of intersection 

are equally defined by the ordered pair (dj,d2) in two 

space. To remove this most uncomfortable ambiguity of an 

infinite number of points in pattern space mapping into one 

point in distance space consider the following assumptions 

assumption 1 pattern space may be represented as a lattice 
of discrete nonnegative, maximally bounded 
points separated by a unit distance; 

assumption 2 the circle described by the intersection of 
the spheres is constructed to contain one and 
Only one lattice point; 

assumption 3 a valid reference point two (R) exist which 
manipulates the circle of intersection such 
that assumption two will be true for all lat- 
tice points in the pattern space defined by 
assumption one. 

Assumption three is logically valid, provided 
assumption one is true, if and only if there exist the 


ordered pairs 
Di = 0 and Dj = (d1;,d2;) mor allj, Xj 1 ڑا‎ 


discrete sample points in three dimensional pattern space 


where 
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Restating equation 3.2 such that when the following 
equivalent equations are both false for all points Yi. (1 
# 3) in pattern space R3 = ( p1:P25P35 ) 1s a valid reference 
point. 


2 2 
das αν d 1j = 9 {3.3} 


2 2 
do; e d 3 E 0 (3.4) 


Expanding equation 3.4, in considering a three space into 


two space transformation, yields : 
2 2 
(X, = R2) = (1; x R5 ) = ð 13.5} 


Squaring and collecting terms results in : 


2 2 2 2 2 2 
SENEC eu Tu ed o 335 7*13Pa * 532;?2.* 
£X 34P3 = 2Χ11Ρ1 = 2X ¿PD = 2X 3;P3 = 0 {3.6} 
2 2 2 
Equation 3.1 allows substitution of Dis for (xii + Xo; + 


2 2 2 2 2 
X 3; ) and “Di; = OE TR a ass ) and 111121 ٤ vector 
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notation for R x.2’s and x 2’ then 
i 3 


2 
E p = 0 1947} 


7 2 
رر ات ری Meck‏ 1 


id‏ 7 دېل 


Equation 3.7 is the logical complement to equation 2.2 since 
only when the equality holds will a point R> = ( Pp,»P>»P3 ) 
be invalid. 

Assumption three, that a valid reference poirt two will 
always exist when assumption one is true, can be proven in 
the following manner. Two sets of constants are present in 
equation 3.7, the differences between the distance ones 
squared and the differences between the data points in 


pattern space for all points (X. , X. ), (1 # J). Selecting 


j 
the largest difference in magnitudes 


UJ 


between distance ones 
squared and the minimum difference in magnitude between data 
points (X) a nd (X) then a reference point two can easily 
be selected such that the magnitude of the dot product of 
the candidate refererce point two and the minimum difference 
between data points (X; 1 X.) is always greater than the 
maximum difference in magnitude between distance ones 
squared. Once the minimum reference point two is found then 


3m e minimum difference in magnitude is that difference 
whose absolute value is closest to the origin. Conversely, 
the maximum difference in magnitude is that difference whose 
absolute value is most distant from the origin. 
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every linear combination of that point is a valid refererce 
point. Furthermore, every point larger in value for the 
maximum case and smaller in value for the negative case will 
٣٠۰۹٦٦٥ except for the case p; = E =D in symmetric 
pattern space. 

Consider the example of a three dimensional pattern 
space which is exhaustively defined for all linear 
combinations of integer lattice points in the range of @ - 

2 2) 


6. The magnitude of the maximum (Di; - Di; 


ο τς )7۸ 


is 128. The 
minimum magnitude of the difference (X4 
(0,9,1). In accordance with equation 3.7, a reference point 


two is easily found such that 


max magnitude (D,,° - کی‎ 


'' len magnitude(X. πλ ا‎ 


(3.8) 


For this example, 
1908 € 2( R5 * ( 0,6,1)) 
implies R5 - (0,0,55) 

In effect, assumption three states there will always 
exist a unique mapping from three space to one space for 
discrete data. 

When equation 3.3 is considered in addition to equation 
3.4 then another degree of freedom is present. The net 
result of this combination is that valid reference point 
twos will exist inside the bounds defined by considering 


equation 3.4 alone. At present valid reference point twos 
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inside the bounds can only be determined by exhaustive 
searches attempting to validate a candidate reference point 


two with equation 3.7. 


D. TRANSFORMATION FROM N DIMENSIONAL PATTERN SPACE INTO M 
DIMENSIONAL DISTANCE SPACE 


Generalizing figure 3.2 into n dimensional space, the 
radius of intersection forms a (n - 1) dimensional 
hypersurface in n space. All the constraints and assumptions 
of the three space transform remain valid for the n 
dimensional case. The derivation in the previous section 
that a valid reference point two always exist in three space 
is but one case of the n dimensional argument. To extend the 
proof to n space simply increase the indices of the vectors 
to the desired value of n. There is no difficulty in mapping 
a (n -1) dimensional hypersphere defined by the radius of 
intersection of m spheres into a single, unique point in m 
Space where m ranges from one to infinity. 

The n dimensional transformation may be stated as 
Given a set of sample data points Y: - (Yi; Y5; Y pp) Gh = 
1, number of samples) in pattern space where there exists a 
set of points K, = (Xii X5i»** «X ui) , (1 = 1,number of 
samples) where X, is constrainted to be 


1. nonnegative uu I 
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2. maximally bounded I j j£ ἃ: 

3. a member of the set of lattice rj) {P} 
points with a unit separation P = {all lattice 
between points poirts} 


K 15 a Constant Scale factor such that all possible 
points in data space are nonnegative values 

a, is the maximum value a (x i) may assume 
there exist a set of sample points D, = (ά 11, ἃ 2199. -ᾱ qu) in 
distance space 
where 

2 2 

5 - 0 - Ry) Te (b = 1,m) is the Euclidean 


distance 


Ri وت‎ ) 
DNE. (pu Poner. 6D up (b 7 2,m) are defined by 
equation 3.2 
While it has not been proven formally, the allowable 
unit separation between points is hypothesized to be 
minimally bounded on the numerical precision of the 


discretization process employed to transform physical 


embodiment into machine representation. 


E. SUMMARY 


A powerful nonlinear transformation has been developed 
which provides a one-to-one mapping from n space to m space, 


where typically (m<<n). The effects of this transform on the 
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information content and cluster formatior ir the 


representation are presented in the following chapters. 
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Uy TRANSFORMATION EFFECTS ON CLUSTERING 


The number of valid reference points (R) has been shown 
Bobe. Infinite. Implicit in this fact is the choice of 
transformations is also infinite. Giver this infinite 
selection of transformations the objective is to determine 
the transform which provides the greatest degree of class 
clustering and interclass separation. Measures of 
improvement are discussed as a means to accomplish this 
objective. 

The conversion of pattern space into distance space is 
presented geometrically to provide some insight into the 


transformation process. 


A. GEOMETRIC INTERPRETATION OF CLUSTER FORMATION 
IN DISTANCE SPACE 


The unique mapping from n space to two space is a 
function of the (n - 1) space tangent hypersphere generated 


by the intersection of the radii d.,d Recall from figure 


l2 
3.2 that the "direction in which the tangent surface slices 
through data space, the range of values for the curvature of 
the surface of the tangential hypersurface over pattern 


Space and class sample point dispersion relative to that 


“direction shape the clustering and class separation which 
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OC CUT Se 

The change in curvature of the surface of the targential 
hypersphere is locally minimal but over the entire range of 
the data Space may be quite extreme, depending on the value 
of reference point two. Points in relatively close proximity 
will have approximately the same tangential curvature 
(figure 4.la). Points which are relatively distant and 
clustered perpendicular to the tangent line will experience 
a greater change in curvature between the points (figure 
4.15). Points relatively distant but havirg nearly the sare 
tangent curve will map in close proximity in two dimensional 
distance space (figure 4.1c). Points in relative proximity 
to each other, in the sense their tangent curves are in 
relative proximity, become more tightly clustered in 
distance space. The physical reality of this fact is that 
the points in relative proximity to one another are nearly 
equal in distance to reference point two. 

The concept of relative proximity does not allow total 
deinterleaving of sample points of different classes. 
However, any class separation which does exist in any one or 
more dimensions in pattern space can be enhanced in distance 
Space with the correct choice of reference point two. This 
enhancement is especially noticable when distance squared 
instead of distance is utilized to determine an element of 
the m space vector since distance squared emphasizes the 


maximum differences between elements of the vectors (X, - 
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Figure 4.18 Similar tangent 


arcs passing through a cluster. 


PATTERN 
SPACE 





Figure 4.10 Variance in 


curvature 


PATTERN 


The curvature of the tangent 
arcs slicing through cluster A 


1s greater than that of the arcs 





passing through cluster B. 


Figure 4.lc Mapping effects on 
different classes with similar 


tangent arcs. 
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δ᾽ 
B. MEASURES OF INFORMATION CONTEXT 


One criterion for determining the degree of class 
clustering and interclass separation is to compare the 
intraclass variability to tne interclass variability. Duda 
and Hart [1] measure this variability in terms of the 
Scatter within classes کي‎ and the scatter between classes 
(S,)- Their technique will be utilized in computing a 
information context measure (I), the ratio of D Mr 6 
dimensional space. This ratio is computed in the following 


Manner. | 


A a dimensional sample mean vector for class i is computed 


as 
i 
p W. 2 X [4.1) 
XEX; 

where 

M; is the mean vector for class i 

wi is the number of samples in class i 

Xi is a member of the set of Samples in class i 


The within class scatter (5 is the sum of the within class 


scatter for each class. The within class scatter is 


41 





calculated as the distance squared from a class mean to all 


points in that class. 


> £i T 
IMEEM TM.) (4.2) 


151 1-1 


is the number of classes 
1s the class index 


) 


E 


p T وو‎ 
(I; - Mj) is the transpose of (X, - M 


where 


To calculate the scatter between classes (Sp), the total 


mean for all classes must be determined. 


E 
2, w Ms 14 ο] 
l= 


is the number of points in class 1 
is the mean vector for class 1 


is the sum of w; for all classes 


where 


Then the scatter between classes (S p) iis 


e 


Sg = Ani tp uc My) {4.4} 


The scatter within decreases as class clusterire is 
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improved. The scatter between increases as interclass 
separation increases. The ratio (Ig) is computed to measure 
the interaction of those two facts. Minimizing this ratio 
when transforming the data samples from pattern space to 
distance space is a measure of improvement contributed by 
the transformation. The term miminize is used in a relative 
sense. The ratio (Ig) will approach zero as the separatior 
between classes increases to infinity or the intraclass 
scatter decreases to zero. Generally that degree of 
separation will not be required. By providing a 
geometrically comprehensiable representation of n space data 
in one, two, or three dimensions the user may be able to 
discern a separation whlch is sufficient without a minimal 
(1ο) ratio. 

The πο) measure, when computed as (Sy / Sg) is, in the 
case of unimodal class distributions, the sum of squared 
error criterion. For multimodal class distributions and 
other complex class distributions other optimality measures 
will be more appropriate. Multimodal class distribution 
difficulties can sometimes be overcome by : redefining 
multimodal classes into separate classes and applying the 
(τα) measure. More complex problems such as dense clusters 
inside a diffused cluster, for example a sphere within a 
Sphere or interlocking tori, will require different 
information measuring criteria. These measures are typically 


application dependent. An example of a three dimensional 
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cube within a cube is presented as a study of utilitizineg 


the (I_) measure on complex problems in the following 


۹ 
chapter. 


C. TRANSFORMATION EFFECTS OF ALTERNATIVE REFERENCE POINTS 


The effect of passing the intersection of the two 
hyperspheres through a pattern space might best be realized 
in examirirg a zeometrically conceivable example. Consider a 
three dimensional set of integer points bounded on the 
interval (0 - 6). This data set is known to contain two 
classes separated by the plane x = y. The points x = y are 
members of neither known class. Figure 4.2 illustrates this 
example. The (I4) ratio in three space for this data Set was 
computed to be 1.699991. An arbitrarily selected reference 
point two R, = (18,21,-1) yielded a (Ip) - 80.819992. As 
shown in figure 4.3a this reference point generates a poor 
mapping solution in terms of clustering since points from 
distinctly separated classes map adjacent to one another. 
Note in figure 4.3b that the poor solution was the result of 
a reference point two which forced the tangential surface 
direction to have relative proximity across classes. A 
beer choice of R, would force the intersection to be 
nearly parallel to the known class separation. Figure 4.48 
shows the results ον ποτε απο selected Eo = 


.(-999,999,1). Here the (I>) ratio in two space was .200012. 
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Figure 4.2 A bisected cube 


I4 = 1.699991 
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Figure 4.3a A poor mapping solution to the bisected cube 


Figure 4.3b A mapping solution 
which forces the tangent curves 


across clusters. 
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Figure 4.4a A nearly optimalmapping solution 


Figure 4.4b A mapping 
solution which separates 
classes and enhances class 


clustering. 
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Figure 4.4 is a presentation of this data in two 
dimensional distance space. This 3ο point enhanced the 
separation to the extent that the means are spread must 
further apart. The separation between classes has been 
enhanced. 

An iterative processing technique must be utilized when 
class separation is not readily apparent. In most cases, 
varying the value of reference point two toward a minimum 
(Iq) proved highly successful in finding a good two 
dimensional representation. The term good implies 
sufficient. A sufficient ratio must be user defined. Figure 
4.4c is a transformation of the example utilizing R, = 
(40,1,6) to yield a (12) = .748836. This ratio is ποῖ 
minimal but certainly can be preceived as sufficiently 


separating the classes. 


D. SUMMARY 


The location of reference points determine the 
information context of the distance space representation. 
When the distribution of classes within pattern space is 
unknown, an iterative technique based on some optimization 
criterion can be utilized to locate reference points which 


provide sufficient transformations. 
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V. EVALUATION PROCEDURE 


Two different experimental procedures were employed in 
evaluating the performance of this dimensionality reduction 
technique. In developing this procedure the initial method 
was to locate a valid reference point (R) before performing 
a transformation. This was done to ensure the transformation 
provided a unique mapping. After deriving an analytical 
method of partially bounding the locations of valid 
reference points this method was reversed. The search for a 
sufficient transforration was conducted and, if required, 
followed by a validation of the reference poirt. The 
validation procedure will be discussed followed by the 


sufficient transformation search procedures. 


A. REFERENCE POINT VALIDATION 


Assumption three of section ὅς states a reference poirt 
(R) exists which will manipulate a circle of intersection 
such that assumption two of that section will be true for 
all lattice points in the pattern space defined by 
assumption one. Without a closed form analyical derivation 
for validating reference points the only way to validate a 
reference point was to transform the data into distance 


Space and verify a unique mapping existed. Confirmation 
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required an exhaustive comparison of each data point with 
every other data point to prove a unique mapping. 

The computational complexity involved in performing 
reference point validation increased exponentially as the 
number of dimensions in pattern space increased linearly. 
This was as expected by the curse of dimensionality . 

The SEARCHR2 computer program contained in this thesis 
ls an implementation of equation 3.7. This algorithm 
computes the two sets of constant differences , )2 ې‎ = 215) 
and (x - x i), and stores them in array data structures. The 
alternative method of implementing the algorithm would be to 
forego the arrays and compute each difference as it is 
required. 

The first method, computing and storing the differences, 
is computationally more efficient in terms of execution time 
when more than one candidate reference point is to be 
verified. This is because the difference matrices need be 
computed only once. The tradeoff for execution speed is 
memory storage. The memory reauirements increase 
exponentially as the number of dimensions. The memory 
requirements can be decreased to some extent by requiring a 
symmetric pattern space. The differences of - = x i) is the 
negative of دت د‎ This implies only (n* (n- 1)) / 2 
differences in lieu of (n ) differences for each of the two 
types of differences computed. Table c.l vividly 


demonstrates the curse of dimensionality and its effects 
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on memory storage required for various pattern space 


configurations. 


Table 5.1 Memory requirements of program SEARCHR2 for 


various pattern space configurations. 


DIMENSIONS RANGE NUMBER OF TOTAL MEMORY REQUIRED 
LATTICE FOR BOTH ARRAYS 
EOLEN ES (RITES) 
1 URS 6 120 
2 8 ۹پ‎ 36 5679 
y 9 226 521862 
4 UNS 1296 14265720 


In this table, memory requirements for the difference arrays 
are based on the FORTRAN G programming language as 
implementated on an IBM 360/67. Single precision, four byte 


numerical representation is assumed. 


The memory allocation requirements can be overcome by 
computing the (n * (n -1)) / 2 differences as they are 
required within the program flow. However the execution 6 
will dramatically increase as the pattern Space 
configuration increases in dimension. Only by optimizing to 
the greatest extent possible might an acceptable program 
execution time be generated. 


The need for this algorithm has been obviated to some 
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degree by the development of an analytical derivation of a 
minumim bound on reference points. This algorithm is still 
required when validating points inside the minimum bound as 
۲۰۰٢ In section ὅς. 

An alternative to circumvent both of these problems 
would be to evaluate a reference point only over the set of 
known data samples rather than an exhaustive pattern Space. 
This technique would cure the curse of dimensionality but 
would not guarantee assumption three for all points in 
pattern space. This concept might be suitable in low noise 
situations. 

This possibility brings to light the consideration that 
a unique mapping may not necessarily be required. What would 
be desirable, but much more difficult to define, is a 
transformation which does not permit samples from different 


classes to map into the same feature space point. 


B. TRANSFORMATION EVALUATION 


The study of transformation effects progressed from 
simple synthetically derived cases in two and three 
dimensions into complex real data in 17 and 32 dimensions. 
All cases were mapped into two dimensional distance space. 
Research was first performed in geometrically conceivable 
spaces in an attempt to galn the greatest amount of insight. 


All studies were performed on an IBM 3560/6". Transformation 
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numerical results were produced as well as two dimensional 
Versatec plots of the resulting distance Space 
representations. 
In performing the various case studies the evaluation 
objectives were to : | 
1. gain an understanding of transformation effects; 
eee confirm that the رت‎ ratio provided a valid measure of 
transformation performance; 
ó. determine methods of locating reference points which 
provide a sufficient transformation; 
4. show that real data can be successfully transformed 
into a lower dimensional representation and still retain 
Information context. 
Some insight galned in pursuing objective one kas beer 
derailed in chapter IV. Further illustrations will be 
provided in the following chapter. The τ... on results 


will document the usefulness of the (I ratio and 


E) 
acknowledge some of its weaknesses. 

The methods of locating sufficient reference points were 
constantly being refined in processing the various case 
studies. Initially it was thought that the 7 
reference points would exist only alorg an axis. This is 
most definitely not true. The search procedure evolved into 
an iterative processing method. This method rated various 


reference points solely on their resulting (Ig? value. Tne 


procedure was to minimize the (I¿) ratio since the smaller 
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in value (Ig, the more information context vresent in the 
feature space representation. The maximum value of the 
magnitude of the reference vector is unbourded. To limit the 
search region the user arbitrarily selected a maximum bound 
magnitude. Utilizing either the positive or negative bound, 
a single component of the reference vector was varied by 
some interval to the opposite bound while holding all other 
components of tne reference vector constant. This allowed 
۲۰۰۰۰. ۶" to observe effects of various values of this vector 
component. The effects were judged by comrvering tne various 
values οὔ (τα) generated. The minimum (Ig) was selected and 
the procedure started again with a smaller interval centered 
around the component value which generated the minimal (I). 
This procedure was continued until a minimal (I! ratio had 
been reached with that component. The process was repeated 
for each component in the reference vector. 

For simple cases of ΤΕΕ OT NOT dimensions 
combinations of two or three minimal component values were 
tested with all other values held constant. This test 
occasionaly provided useful results but was not consistent. 
After each component of the reference vector had been tested 
individually, all minimal (σα) producing components were 
combined together and tested. For all test cases, this 
procedure always yielded the lowest (1) measure. When all 
(Ig) measures were compared against their plots the minimum 


oS always had the "best" appearing plot in terms of class 
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clustering and class separation. 

As of this report this iterative processing procedure is 
the methodology recommended. However, this procedure is not 
without faults. The test and evaluatior procedure requires 
testing each component of the n dimensional reference 
vector. This is a minor bother in low dimension pattern 
Spaces but becomes quite awkward in high dimensional spaces. 
The 32 space reference vector would have required 34 
computer runs to claim a satisfactory search τος 8 
sufficient reference point. Secondly, it was discovered, not 
unexpectedly, that local minima of ίσα) exist within the 
bounded set of possible reference points. At vresent there 
Nro closed form solution for finding the optimal reference 
point. The only way to overcore problems of local rinima is 
extensive testing. Thirdly, if a sufficient reference point 
is found to exist below the minimum boundary for reference 
point two, the SFARCHR2 program will be required to validate 
the reference point. This complicates the situation even 


further with all the limitations of that program. 


C. Implementation tradeoffs 


This technique provides the researcher or engineer a 
choice of alternatives. One alterative will require a 
certain amount of not inconseouential time and effort to 


find a reference point or points to provide a sufficient 
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Ence Space representation. But the fruit of that effort 
EE de the ability to perform the remaining portions of 
testing and training in distance space. Significant here is 
that the time consuming portion of the effort is devoted to 
the training phase. This is typically not the phase which is 
time critical. The distance space representations are 55 
computationally complex. Hence, the testing phase will 
Benefit from the reduced complexity with decreased execution 
times. This will be especially useful in real time decision 
making applications where the testing phase is time 
wt Cal. 

The second alternative is to forego the time comsuring 
effort in training but with a commensurate increase in 
computational complexity in the testing phase. 

The researcher or engineer must judge which is the most 
cost effective for his application. The following chapter 
will hopefully provide some insight into what is required if 


the first alternative is selected. 
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VI. EVALUATION RESULTS 


In evaluating the transformation seven test cases were 
studied. The evaluation proceeded from simple three space 
problems to a complex 232 dimensional real data problem. 
Discussion of each case comments on how the data samples 
were derived, the procedures in evaluating the case studied, 
and the results. Graphic illustrations are provided as 
appropriate. The appendices contain complete documentation 


on the progression of testing for all cases studied. 


A. CASE 1 : A THREE CLASS THREE SPACE PROBLEM 


A simple problem was first attempted to gain insight 
το The transformation process. Figure 6.1a illustrates the 
heuristically derived points in pattern space. Appendix A 
Contains a listing of the points which make up each class. 
The transformation was from three space to two space. In 
three space (I) = .2319393. The best (12) ratio achieved, 
in a less than exhaustive search, was 0.0'7986128. 

Various linear combinations of reference point twos (82) 
were tested to observe the transformation effects on pattern 
Space. The distance space representations were plotted with 
the X axis as distance to the origin sauared and the Y axis 


aS distance to R, squared. It is interesting to note in 
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meeure O-. la A three class three space problem 


Iz = 0.231939 
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figures 6.20 - f the results developed utilizing various 
linear combinations of an R, poirt. Observe that the 
relative proximity of the classes is unchanged while the 
relative positions within the classes are a function of the 
reference point two utilized in the transformation. This is 
to be generally expected as tne within classes relationships 
will change as the reference point two changes. This is also 
a function of the fact that the distance to the origin rever 
changes while the (4 2) values vary as the (Β 2) vary. 

This last observation suggest an examination of 25 
reference point one from the origin in an attempt to imtrove 
class separation. While it may be a valid concept the 
transformation becomes much more complex in the process. 
This examination is suggested as a topic fer further 


research. 


B. CASE 2 2: A THREE DIMENSIONAL BISECTED CUBE 


A three dimensional cube of integer lattice points was 
developed for this study. This case was previousily 
discussed as the geometrically conceivable example In 
section IV C. Figure 4.2 illustrated the three space 
configuration of the classes. 

This case has some interesting complications. In pattern 


Space the (I4) ratio is 1.699991. The class means are 
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EV v ' 
class 1 ) تت‎ τε; :.55,. 1.5.) 
class 2 Mess ces). 
The scatter within classes (S,,) are equal. An M ratio 
greater than one implies the distance between the two class 
means is less than the average distance between a class mean 
and the samples within that class. Even with the (Ig? ratio 
greater than one there exists a distinct linear separating 
boundary between the classes. 

Appendix B contains a listing of the data points in each 
class and a summary of the iterative processing steps for 
this case. Ten iterations were required to achieve an 
“optimal” value. As noted in chapter IV a sufficient 
solution was obtained on the fourth iteration. This 
demonstrates the value of having a two dimensional picture 
of the data on which to make judgements about that data. 

It occured to this researcher, upon examining tne 
results of iterations six and seven (see appendix B), that 
the minumum value was symmetric in magnitude in the X and Y 
Bommponents. Iterations 7 — 12 attempted to exploit this fact 
by testing beyond the user defined bound of 999 in the X and 
Y componerts of the vector. This proved quite successful as 
figure 4.3a illustrated. By symmetrically increasing the 
values of the X ard Y components the (15) retio was 
minimized. As reference point two is moved further from 


pattern space the change in curvature of the tangent 
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intersection becomes almost nil. This occurs because the 
circle of intersection begins to approximate the surface of 
the sphere defined by the (dj) distance as shown in figure 
6:2. In effect, this forces similar points to map almost 
linearly into distance space. This fact accounts for the 
apparent subclusters that exist in each of the classes. 

In step seven, the Z components were varied to study 
their effect on the (Ij) ratio. As can be seen from the data 
increasing 2 in magnitude above one adversely affected the 
(I5) ratio. In iterations 9,19,and 11 note that 6 
points in the X,Y plane yield similar, if not equal, 
results. This can be explained by realizing that the 
“direction of the circle of intersection of the various 
symmetric points and reference point one are very nearly 
eat. They differ in that the R, sphere is located on the 
G@pposite side of the R, sphere. 

This case study proved the most enlighting es to tne 
geometric effects of passing the intersection of the spheres 


through pattern space. 


C. CASE 3 : A CUBE WITHIN A CUBE 


This case was selected to study the effectiveness of 
using the (Ig) measure in a complex problem. Two cubes were 
generated in a three dimensional pattern space containing 


integer lattice points in the range (2,0,0) to (5,5,5), 
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Berne 6.2 Change in curvature of the tangent intersection 
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In two space the secant line of intersection begins 
to approximate the curvature of the circle 
defined by d,. As R, is moved away from pattern 
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space the curvatufe of thoe Ro circle becomes 


almost nil. 
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Appendix C contains a complete listing of the data. The 
outer cu9e exhaustively surrounded the inner cube. The inner 
cube mean was (3.0,2.0,2.5). The outer cube mean value was 
(2.84,2.84,2.5). Thus the outer cube mean value was 
"contained inside the inner cube. The three space (I4) ratio 
was 2950.249. The "optimal (I2) ratio was 66.218964. Figure 
6.5a 1s the resulting two space representation. The 
reference point two which yielded this result was (6,1,-1). 
A listing of all points tested is contained in appendix C. 

A more visually appealing result is illustrated in 
figure 6.3b. Generated from R> equals (360,-60,1), the (12) 
ratio was 2574.547. The points are bunched into six 
clusters. Each group of points can be characterizd by its 
location on the Z axis in the three space representation. 
For example, the group located nearest the X axis in the two 
Space representation is all the points located on the Z= @ 
plane in three space. 

This example provides some insight on how the 
transformation skews pattern space into distance spéce. In 
this three space to two space example, the perspective is 
changed much like an artist would skew an image to provide a 
three dimensional perspective on a two dimensional canvas. 
This suggest there may be some applications for this 


transformation in the field of computer graphics. 
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Figure 6.3a A two dimensional distance space representation 
of a three dimensional cube within a cube. 
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8000. Figure 6.3b A visually interpretable two 


Space representation of a three space cube 
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D. CASE 4 : THREE SPACE SERIES OF CONVERGING CLASSES 

This study was a series of five cases in three 
dimensional space in a lattice containing all integer points 
from (0,0,0) to (24,24,24). The cases differ by the relative 
location of the two classes in space. The data poirts for 
the two classes were generated on a Texas Instruments TI-59 
calculator using the random number generator program 
(ML-15). The class one seed was 2135. The class two seed was 
7540. The standard deviation used was 2.0. These parameters 
were kept constant across the experiment so thet the only 
parameters of variabllity were the distance between classes 
and reference point two. Table 6.2 contains the mean samples 


generated for each class. 


Table 6.2 Sample means for three space series of converging 


classes 
case class i mean class 2 mean 
X y 2 Y y 7 


( 4.25, 3.41, 3.28 ) (20.16, 19.65, 19.58 ) 
) 6.98, 5.41, 5.08 ) ( 18.33, 18.50, 17.66 ) 
( 8.00, 7.50, 7.28 ) ( 16.35, 16.50, 15.67 ) 


( 9.16, 9.41, 9.908) (eso 1450, FRE) 


oO مم‎ A N Pe 


( 12.08, 11.41, 11.98 ) 0) و12‎ 5 τοσο 11467.) 


This study was two fold in purpose. One goal was to 


observe the effects on selection of R^ as the classes 
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approached one another. Secondly, an attempt was made to 
distinguish where the transformation would not longer 
separate classes. 

As before all cases were processed using the systematic 
iteration procedure delineated in the previous chapter. The 


following results were obtained. 


Table 6.3 Iq results for three space converging classes 
ease Γη 1 2 reference polnt iterations figure 
1 0.061068 29.014587 ΕΕ, 6 0ِ چ‎ 6.4a 

2 0.126720 6 ( 63, 63, 63 ) 4 6.4b 

ó 9.258156 3.47232 (-99,-540,-99) 5 6.4c 

4 9.813121 9.153407 (-99,-548,-99) 4 € .4d 

5 32.466873 4.562885 (-150,-908,-150) ó 6.4e 


Cases one and two share similar reference pcints as do 
cases three and four. Urfortunately, there is not 5885 
samples here to rationalize why this is so. Since the 
classes vary between cases only by their separation then it 
will said that the relative proximity between classes does 
Τ.Ε choice of .د‎ In case five, tae classes shared 
the same mean. They were highly interleaved as shown by tne 
I3 ratio of 52.466875. The change in the I, ratio is a 


measure of how much deinterleaving took place in tne 
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Figure 6.4b Two space solution to case 2 
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Figure 6.4c Two space solution to case 3 


I4 = .238156 I, = „472320 
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Figure 6.4e Two space solution to case 5 


I, = 32.466873 I, = 4.560885 
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transformation. Case five further supports the premise that 
the relative proximity of the three space data was 
maintained in that total deinterleaving did not occur. This 
technique claims to only enhance separation present in 
pattern space in the distance space representations. To 
further comment on the behavior of 82 will require a more 
exhaustive examination of its performance under similar 


situations. 


E. CASE 5 : TEN SPACE SERIES OF CONVERGING CLASSES 


This study is a series of four cases. Pattern space is a 
ter dimensional integer lattice cortaining all points from 
the origin to (19,19,19,19,19,19,19,19,19,19). Two classes 
were generated in each case. The samples were synthetically 
derived using the IBM 368/67 and utility program LLRANDCM 
entry point NORMAL. The seeds were held constant for each 
class over all four cases. The variance selected was 2.2. 
The following means were generated for each of the classes. 


Read a class mean vector as a column in the table. 


Table 6.4 Sample means for ten space series of converging 


classes 


case 1 2 $ 4 


class 1 2 1 2 1 2 1 2 

















Ice Áo neo 


4.12 15.43 5.12 14.56 ΕΕ 16 9.81 6 





7$ 





Deo 15.85  ء۔ہ‎ 2 8.43 12.62 AS 7۹٩ 

4.06 15.43 5-5 8,26 12.45 190.31 190.406 

4.56 16.59 6.18 14.96 8.26 12,4 10.21 187+6 

2.93 15.93 6 14.56 8.26 11.93 9.93 9.78 

7ے 10381 ۱12.31 21232 14.26 5.75 15.37 4.50 

2.25 16.18 5.81 14.25 8.62 12.18 112.37 9.12 

RSI 167 5 6222 12 3.06 12.00 9.93 9.86 

m5 17.99 ο 18 117 7 + 9 52 9,0 6 

4.00 16.12 6.43 14.37 8.22 12.67 19.18 5 

The goals of this study are similar to the previous 
study in three dimensions; to observe the behavior of R, as 
the classes approached one another and to atterrt to 


distinguish when the transformation would no longer separate 


classes. The results obtained are detailed in table 6.5. 
Table 6.5 Iq results for ten space converging classes 
Case Io 12 iteration figure 

1 20.069465 0.004561 1 6.5a 

2 0.158126 0.023578 1 65D 

5 0.594771 0.062027 1 6 6 

+ 36.600388 8.294548 8 6 σα 


The la results were obtained with the following reference 


polnts: 
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Table 6.6 sufficient reference points for ten space 


converging classes 


case reference point two 
یب‎ -..55π.5/..55. 56, 57, 58, 59, 62) 
(-591 ,-502,-503,-594,-505,-506,-507,-£08,-5989,-510) 


(-581 ,-502,-503,-584,-505,-526,-507,-528,-509,-51%) 


PP A N عم‎ 


( 999, 890,-821,-219,-111, 929,-999,-411,-511,-611) 


In observing that only one iteration was required to 
find a sufficient separation, it can de said that the 
inherent separation in the data allowed a wide choice cf R, 
to provide a sufficient transformation. It is interesting to 
note that cases two and three utilized the same reference 
point. This is the same occurance as with the three space 
study. In both studies the reference points for the 
noninterleaved cases were not near the sufficient Solution 
reference points for the interleaved cases. 

The transformation had no problem maintaining or 
enhancing the inherent separation in the data. Only in the 
overlapping case was an I, < 1 rot achieved. However, a 
Significant reduction in the I, ratio was achieved in all 
cases. 

In the fourth case of this study the adminstrative 
complexity of high dimensional data became a burden. To 


allow sampling over all elements of the R vector ten 


el 





iterations should be required. In the evaluation only eight 
were performed as modifying the individual components of the 
reference vector became unwieldy. The burden could be 
essentially overcome with a more automated test procedure at 


the cost of more computer execution time. 


G. CASE 6 : TEN SPACE THREE SHIP RADAR TARGET RECOGNITICN 
DATA 


This study was conducted to observe the performance of 
the transformation on real data in high dimensions. 

The data was collected by the Naval Weapons Center, 
China Lake, California as part of a research effort on radar 
ship classification techniques. The samples consisted of 
radar profiles of selected ships. The samples experienced 
some preprocessing prior to being input to the 
dimensionality reduction technique. The received radar 
echoes were taken from the radar receiver and fed through an 
analog-to-digital converter and eventually stored on 
magnetic tape. The remaining preprocessing is shown ir 
figure 6.6. 

The samples were gathered in 512 dimensional space. For 
the purposes of this study only the first ten components of 
each sample were utilized. When received from NWC the 
samples ranged in value from -8.@ το 1.6. To reet the 


assumption that the data exist in a lattice pattern space it 
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Figure 6.6 Preprocessing flowchart 
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was scaled into an integer space ranging from € to 348 in 
each component. Fach real number component was scaled with 
the following procedure : 

1. add 8.0 

€ multiple by 32.0 

oe ada 6.5 

4. truncate the fractional part. 
Appendix F contains the resulting samples and the iterative 
processing results. In the first case of this study each 
class contained 16 samples. 

The ten space data had a (110) ratio of 2.752768. The 
sufficient (I,) ratio was „189989 when processing ceased. 
Twelve iterations were required to achieve this result. 
Figure 6.7a is the two space result of the transformation. 

The iterative processing technique proved effective. 
After identifying the "best" value for each component of the 
reference vector in iterations ! - 11, the "best" value for 
each component was placed into a single vector. This step 
yielded a result of @.442269 and figure 6.70, In examiring 
each of the components of the mean Sample for each of the 
Classes it was observed that the components with the most 
variability between classes developed I, minimizing 
reference point components which were not near the user 
defined bounds of plus or minus (9999,9999,...,9999). In 
this study components one, two, and three of the sample mean 


vectors exhibited this behavior. The remaining components 
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had miminal variation of mean component values between 
classes. The remaining components generated reference poirt 
two component values at the user defined bounds, -9999 or 
9999. 

In making these observations it was decided that the 
"best" value for those components with values at the bound 
had not reached the minimum (I5) for that element. These 
particular values were increased by a factor of ten and 
tested again. This was the vector which generated the 
minimum (10). This behavior is similar to that documented 
for the X and Y components of the bisected cube problem. 

After determining the reference point two which yielded 
the lowest (I,) over the 48 sample set it was decided to 
test the entire set of training samples. The training 
samples consisted of 423 samples divided into three classes. 
Class one contained 141 samples. Class two consisted of 137 
samples. Class three had 145 samples. Two reference points 
were- tested. The first was the value determined for the 48 
sample set. The second point was similar to the first but 
with the negative -9999 components increased by a factor of 


ten. The following results were obtained. 

Table 6.7 Ten svace Ship profiles reference points 
reference point 12 figure 
( -3200 , -4528 , -7028 ,—-9999,-9999, ο ποιο. Exec 


99999 ,99999 ,99999 ,99999 ,99999 ) 
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( -3329 , -4583 , -7303 , -99999 ,-99999, 
99999,99999,99999,99999,99999) 1.518979 6.7d 


Figure 6.7e is an enlargement of the heavily clustered area 
of figure 6.7c. While there is a large amount of ncise 
present, as would be expected in real data, the claim will 
be made that three distinct clusters of data exist, one for 
each class of ship. Figure 6.7f is an enlargemert of figure 
6.7d. The same claim regarding clustering is made for this 


representation also. 


G. CASE 7 : 32 SPACE THREE SHIP RADAR TARGET RECOGNITION 
DATA 


This study is a continuation of the previous study in a 
higher dimension space. The same ship profiles were utilized 
with 32 components per sample instead of ten. The samples 
were scaled in the same manner as the ten space samples. 
Appendix G contains the references points tested in the 
iterative processing and the sample means for each of the 
classes. The samples are not listed due to their large 
number. 

The two space representation of 32 dimensional samples 
in figure 6.8 exhibits much similarity to the ten space 
representation in figure 6.76. The general location of the 
three ship classes is unchanged between the two figures. The 


ντ point which generated the 9.189087 (I5) ratio for 
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the ten space study was utilized as the first ten components 
of the 32 space vector. Sixteen iterations were required to 
test the first 24 components of the reference vector. The 
minimum (I5) ratio obtained was 1.624708. The 32 space (1312) 
was 3.607182. The similarity between the 32 and 16 space 
revresentations is as much as result of the data as the 
transformation. A discussion of the data and its meaning is 
beyond the scope of this thesis. The claim is again made 
that the two space representation contains three distinct 


clusters, one per ship. 


SS UCASE STUDIES SUMMARY 


A series of seven cases have been tested. The studies 
highlight various effects found in the transformation 
process. The simple three class three space 777 
illustrated the changing relationship of data within classes 
when R, is fixed at the origin ard Rj is moved around. The 
bisected cube provided insight into how the curve of 
intersection passed through pattern space. It further 
demonstrated geometrically how the curve of intersection 
should cross pattern space to achieve the greatest amount of 
class clustering. The cube within a cube example was 
utilized to study the use of the (Ig) measure in a complex 
problem. The (τα) retio was shown to yield good results when 


used as an optimization criterion. However, it was also 
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shown that when different goals are desired (graphical 
display) (I ) may not be the best method of achieving that 
objective. The three and ten space converging class studies 
demonstrated that as long as some separation existed between 
classes that separation could be enhanced in the lower 
dimensional representation. They further illustrated that 
the transformation will not remove class interleaving 
inherent in pattern space representations. Stated 
differently, the general relationships which exist in 
pattern space will be retained in the distance space 
representation. These two cases demomstrated that the 
transformation process can function effectively in a noisy 


environment. 
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VII. CONCLUSIONS 


A nonlinear transformation has been develoved which 
retains or improves relative proximity of Similar 
information while significantly reducing the representations 
of data for several specific cases. These studies have shown 
the feasibility of this technique. They suopert the 
supposition that this transformation is a valid process 
sultable ος general applications of dimensionality 
mesoctilon. 

The concept of information context is valias By 
representing Dm m dimensional Space the relative 
relationships of data in n dimensional space, rather than 
the data itself, there is essentially no loss of contextual 


information in the lower dimensional representation. 


A. RECOMMENDATIONS FOR CONTINUED RESEARCH 


1. First and foremost is testing the reduced 
representations in a pattern classification algorithm. To 
truly Judge this ar effective technique the pattern 
Classification results must yield equal or better results 
than the classification results obtained with tre n 
dimensional data. 


2. Development of a better method of efficiently and 





rapidly locating optimal” reference points is critically 
needed. The current methods will become unworkable as higher 
dimension spaces are tested. The method could be some closed 
form analytically derivable result or an iterative search 
computational method. 

ó. High dimensions should be explored to observe any 
effects whlch may present themselves. 

4. The minimum bound on the lattice point interval 
should be determined. This researcher feels it will be the 
smallest interval which will still uniquely represent 
information at the desired level of accuracy. AS an example 
for single precision FORTRAN on the IBM 360 (7.5 digits 
accuracy) if the interval is 20.0001 then all points in 
pattern space must be capable of being uniquely represented 
within the remaining 3.5 digits of accuracy. A second bound 
On the lattice interval will be the discretization process. 
If an analog-to-digital converter collects eight bits of 
information then those bits define the information cells of 
Pies lattice. 

5. Different measures of information context needed to 
be derived and compared to the current definition. Is the 
concept of measuring localized distance as defined by Meisel 
[2] a valid measure? Duda and Hart [1] also suggest several 
alternative measures. 

6. The effect of assigning to reference point one values 


other than the origin should be studied. 


oF 





7. Is there any significant advantage to mapping thrcugh 
a series of distance spaces to further enhance relative 
proximity? This could be done by one mapping to, for 
example, two space followed by several two space to two 
Space transformations. A second method would be to map from 
EE ce ton — l1 space ton - 2 Space to ... to two space. 

8. Given that the data can be uriauely mapped into one 
dimension, Can a reverse transformation be found to return 
the data to n dimensions? This question is complicated by 


the fact that the solution exist in norcontinuous space. 
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APPENDIX A TEST DATA FROM CASE STUDY 1 


A. SAMPLE DATA 


sample Class Index number 
EN 1, 1 1 1 
EN ὦ, 2 1 2 
EE 1, 3) 1 3 
EN D. 1 ) 1 4 
moe, 4 ) 2 5 
( 3, 4, 4 ) 2 ع6‎ 
دک‎ 5, 4 ) 3 7 
Ex. So, 6 ) 3 8 
ME E, 5) 3 9 
fs, 5.6 ) 3 12 


B. REFERENCE POINT TEST 
REFERENCE POINT is 
1. ITERATION 1 


2966678. ) 6 1 ,1 ب ) 
0946914. لل - 1 ,6 ( 
2123157. ) 8 ,21 ,1 -( 
u «68604536‏ ,1 - ,6 ( 
2798612. ) 6 1 - ,1 ( 
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1 0 


به یه به نہ یہ نیہ یہ نہ یہ نہ یہ نہ یہ یہ ہے ہے پې ېم پے ېې ېب ہے ہے ہے ہے ہے ہے ہے ہے ہے ہے ہے ہے ہے ہے ہے ہے ہے 


ني يني ني سي ني تي ني ان ني ني نن کي سے ني سے ہے سن u‏ ني تي سے سے ني يس ني سے ين ني نن نس پټ ېن ټس ني سے سي سي 


ہے S. e Q(Q T Ὁ‏ رئ یہ ام نی ئ یہ ہے ی QQ tO) S. e QU EO)‏ بې ANN) QAQA‏ تہ .00 (QJ‏ ېم S‏ حم τήν‏ ئی ئ بہ ہے کا 


e 9 eo 9 o a وی‎ e ^ eae ο ο e ٧م‎ ο ^ ο ۴6 جح يي‎ o ط3‎ ϱ 9^ & ^ ٧۷٥ ^ ^» ο ο ο ο Ff e e 


ہ۱ وہ نہ یہ نہ یہ ہے ہے ہے ہے ہے ہے ہے ہے ہو مو بی ٹیہ 0[ 10 19 9[ «ἡ «Ἢ -ῇ -ῇ‏ بی بی ریہ لی ور رص ور ور یہ یہ نہ نہ 


ee a ο ο ο ο ο ^» a لق‎ 6 a مه کسه‎ O 9 ea o o یج‎ 9? Q ea SS ^ 9?» ^» ^o» ^» & a e» ^» QQ تق‎ ϱ e 


HHHH HHHH HH HH HN (N CQ. QQ OQ. (OQ QI Q EO EO t9 tO ) NW WN tO tO tO tO tO tO to) رح‎ Y اپ‎ 


ہےے خښ سید ےہ ہہ سید ue‏ ي۷ )ن مه خر ي۷ cur‏ سے و یه په خي ښښه يا په يي ښڼه ښڼه یه A A DL DIA IT AE haa IA ausi‏ 


Class 


Sample 


SAMPLE DATA 


A. 


TEST DATA FROM CASE STUDY 2 


APPENDIX B 





> AAA Y e Y a Y a ai 
کر ر ر حر ر ر ر حر‎ e 
دم هم هم‎ N N NN A A 
ىم رم‎ e حی عم رح بین‎ Ὁ 
"aus asas ua” ut ىر ده‎ rat ΒΡ, نن ره‎ 
N N NN N N N N N 


B. REFERENCE POINT TEST 
REFERENCE POINT Ie 
1. ITERATION 1 


(- 1, ix 6 ) 18.244924 
( 6, - E, JE 1.575197 
(- 1, 21, 8 ) . 6"8E84 
( 6, - 1,- 1) „872244 
( 1, - e 6 ) 18.244924 
2. ITERATION 2 
( 2, - ES 18 ( 1.524258 
(- E: 16, 21 ) 2.392746 
( gn. 18, - 1) 80.819992 
( 18, 21, - 1) 80.819992 
( 18, - il. 21 ( 2.392746 
(=> 1% 12, 15 ) 2.391693 
(- 1, 15, 12 ) 1.246020 
( 12, - 1, 15 9 2.391693 
( 15, - l, 125 1.266920 
( 12, 1, - 29 36.219989 
( 15, 12, - 1) 36.319989 
( 8, - 1%: 1» Aa dud. 1 
( 19, - 1, 1) .454380 
( 14, - Te 1 ( . 464800 
( 20, - = 1 ) ‚514694 
3. Iteration 3 
( 15. — m, i.) ‚458060 
( 12, - t. 1 ὶ „453136 
( 15, - 1, 1 Ὃ) . 472577 
( 16, - 1, a . 489899 
( 17, - 72 1 ( . 4894 44 
( 18, - i. 9 . 498997 
( 19, - al 15 . 596450 


1 





«4860899 
. 498007 
.906450 
. 514694 
. 522686 
. 474437 
.4608€0 
.493555 
+6 
S2257 
.602825 
. 748856 


. 3568 00 
. ¿03828 
ےے٤٤‎ ٤22 
. 202012 
201783 
. 19706 


.268448 
. 2781 
. 289005 
. 296527 
. 929625 
.613895 


veo] 
. S6502 
8 
1.450512 
2.294062 


.2690€2 
. 5000512 
. 29 
. 205779 
. 200923 
. 204229 
207613 


esl A ρω‏ بے € e‏ اسا اس سے يټ 


هه اه ېر اه اسي ده خښ erai‏ سنه سسا ت س مس ree‏ فص نه د ده 


equi‏ ص نڅ ست ο‏ صیہ سیه يګ 


O O) ںی‎ AY Y Y نی‎ N N N N N 


Rh pi 


[- 2 {2 [-2 12 [2 


13 
24 
2 


mr 
A Y P DEC O (y 
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RR PRR Pep 


ο دح‎ 9 9 9 « Ὁ ο 


Der 
- 9 Ὁ 


ول 


15, 
14, 
16, 
W, 


EE 


12, 
lai 
12, 
Ion 
1 


16, 
18, 
19, 
20, 
zi 
12, 
i, 
16, 
18, 
20, 
40, 
40, 


Iteration 4 


12; 
Tow 
Deo. 
Ie, 
ie, 
12, 


Iteration 5 


DS 
12, 
12, 
12, 
I2, 
11297 


Iteration ۴6 


- ENS 
12, 
12, 
= 2125 
c ges 


apr, مو مس یسے‎ uam 
۱ 


Iteration 7 


= ¿E 
— Mes 
= OB 

50, 
“τ 
وپټ‎ 

99, 


ap, fy, fn, fm, fm, Gar m 


Iteration & 





200925« 
200402. 
200232. 
.e00402‏ 
2ے 20ء 
200923. 
21475 
205619 . 


. 200120 
«204110 
.200160 
.20416 


. 27 
«220055 
«506058 
2 
.227540 


. 5 
«200016 
.200191 
. 200012 
.200012 


قر ی يه eas u‏ اس a? ὦ u u νο ων‏ — ضیے۔ یہ 


mu, oa) uai ΒΒ». ΒΡ‏ خد 


مر فر یویم فر یں مر یں 


nor 


Per 


190 
120 


WRF Oe 
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99, 
150, 
200, 
158, 
200, 


ο, 
96, 


500, 
300, 
206, 
206, 


350, 
490, 
500, 
5e, 
400, 


620, 
700, 
80€, 
999, 
999, 


997 
159% 
209, 
Ίου, 
200, 

99, 

SU 

ο 


( 
( 
( 
( 
( 
( 
( 
( 


9. Iteration 9 


300, 
300, 


- 300, 


500, 


( 
( 
( 
( 


19. Iteration 10 


350, 
400, 
500, 
500, 
420, 


( 
( 
( 
( 
( 


11. Iteration 11 


608, 
700, 
800, 
999, 
999, 


( 
( 
( 
( 
( 
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ںہ نہ نہ یہ یہ نہ یہ یہ یہ یہ یه ته یه ته ته ته یم نہ یہ نہ نہ نہ نہ یہ نہ یہ نہ ہے ہے ہے بے ہے تک ہے بے كت ۳٦٦‏ 


ېر شر سي سر شر شر شر شر سے سے شر سے سے ےط مر شر N m a‏ 8 77( سر سي متس پټ من مت ني نر 


ری ی دم ہ ہہ ہ ہ ہ ہہ ہ ہ ہ ہ یئ ہ ہ ہ ہ ہ ہ ہ ہ ہ ہ ہ یم مہ ہ یہ ئ نہ ینہ ئ۵ یہ ئ یہ 


e e ee eo αυ e ما‎ e e ما‎ ο e © a ne ο ^ e. e a سا‎ ο a ^ 9» oe مي‎ e e e a مھ‎ e ae e ο 


φωτο‏ مب ویضه ور یہ ہے بی ٹیہ وص یہ ہے ری ا QUO RIO ANNO‏ بے وی ہی UO‏ وی یب اټ تپ یہ نہ ہت ا 


^ e ο ο e ما‎ e e a ο e αυ eo e e ^ e e e ما‎ € e a o 9. ae a سر ما‎ e ee e ما‎ ο ο ο 


ہے df HY OO O NMG‏ بب t9 tO tO tO H‏ وہ یہ نیہ یہ یہ یہ ہے ہے ہے ہے ہے یہ یہ لپ ہت ئہ مئ ئ ۵ ئ٠ ٢‏ 


Class 


Sample 


SAMPLE DATA 


A. 


EEN CTE DATA FROM CASE STUDY 3 





15 


دو ونو ود د د د د ه و د اوو ود 2( یہ یہ لہ لہ یہ یہ و و او و و واوو و وو وو و ولو و یہ یہ یہ یہ یہ یہ یہ یہ لہ یہ یہ یہ 


Απ σσ کت ني نټ‎ gro, Gro e, que ea, GF c κω ΚΠ ΚΠ (Gyr ou, ني‎ Gur ss ي٠ ننس ني تت اي‎ Gr سي ني ن٠ تي تر کي تر‎ ΠΝ ΚΝ κ يي‎ ΑΠ ΚΠ ني‎ ΚΝ ΚΠ ΚΠ ΚΠ EA AA A A 


* ο €9 همه‎ ο ο ο ο ο ο ο ο ο ο ο یچ‎ 0ο ο ο A 9^ & ο A 9^ ο ο ο ο مج می‎ A o^ o» θ ο ο A یج و‎ A 9^ ο ο ο ο ο ο ο ο 
. همه چم‎ e ϱ ο ο ο ο ο ο ο ےج‎ ο 9? 6 می‎ ο 6 که‎ ο ο ο ο ο ο o ο A مج همه‎ 9 0o o^ ο ^ A A که‎ ο ο A A A 9^ A A & 9^ ےج‎ ο 


uA Qe us Meee” Se See” See” See?‏ خپ رېه ues‏ ےہ هده mu as us‏ خڅښه ره صښښ۲ه ا νυν, Ου",‏ مہ بی ےہ ښوه ښیښښه څښه ښم يه ےہ Sus mU Da ues uu‏ ےہ Te‏ ت سا oss Vu‏ ره سے سی بے وه پوه خښه ېه 
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لہ یہ یہ یہ یہ لہ یہ یہ یہ یہ یہ یہ لہ یہ یہ یہ یہ یہ یہ یہ یہ یہ یہ یہ یہ د د وهو د د د د د د د د و د وو د د ده د اد د ده د ده یہ یہ 


مت سي و اس ني سے پیج یسے سن سے مت تيل مول دض سے مول سم Q P‏ پو نس سر توو نس پو کو متوو سے GP, um, qu, GP‏ ني مو تت مول من تیل سے مول ول دل مول تت سے مو مول مخ مخ سے 


م tO fO f» NN‏ م دم ئ۱ یہ یہ یہ یہ رہ ہے ہے ہے ہے ہے یہ یہ یہ یہ یہ ہے ہے ہے ہے ہے بی بل بې ہپ BH dd Hd HHA‏ بب Y Y E‏ م tO‏ م حم ج٣‏ یہ یہ 


-. ο ο ο ο ο ο o ο ο ο مم‎ ο ο A A 9» ο ο ο ο ο € ο A A که‎ A يوي‎ A A ϱ A 6 مم‎ A ^ A 9^ ےچ‎ ο ο ےچ‎ o 9 ο ο ο 9^ 2. e 


uw) OOO OOO O N E)‏ زی 10 D‏ (گا 10 )0 00 10 SS SE SR SS a GQ G UD‏ 95ا رگا FAO ANA ORO 10 10 10 uU)‏ رص یہ ہے ری الب 


- ο e 9 9. سا‎ e e e e e e e ې‎ e e e a e e e e e e ها‎ e e e ον 9 سا‎ e e e a 9 9. 9. e e a سا‎ > e 9 a a e a e e 


DMM MMM MO 10 00. 0 UD 00. e ئ یہ‎ ١ په ریم یہ ہے ری‎ UO e OQ tO) «BU e OQ CO. «Hu e QU tO) «B ي رئ یہ ہے ری‎ D 0 یم‎ CO. «Hw ANNA 


سے۔۔* ې په ره ο qu E‏ خي کی کی یی ےه یی سے ا ا س اس سی یا Mngt d‏ ےہ سے اة کی ی اة یا س په e dl‏ نک —P‏ نه —ÀÁ—‏ —— ——— سي بپ 





me, 5, 3 ) 2 


B. REFERENCE POINT TEST 


REFERENCE POINT ٣ 
IE ITERATION 1 
( 21, - ĝl, 18 ( 5261664 
( - I, 18, 21 ( 560 .919434 
( 21 18,- 1) 274.874923 
( 18, 21, =- 1 ( 274 874222 
( 18, - 1 21 ( 568 .919424 


D. ITERATION 2 


( 18 - ie =) 165.419464 
( 12, - i w) 148.707962 
( 15, - 1١ i) 220. 954296 
( 16, - 1, 1) 219.476013 
( 17, - 1 11 238.391846€ 
( 18, - 1, M 257.587891 
( 19, - ie a) 276.977 295 
( 16, - 1 2) 217.550034 
( 18, - 17 2 ( 252 ۰ 
( 19, - Qt 2€ 275.258"789 
( 20, - I, 2 ( 294 „342041 
( 21, - 1; 2) 314.477783 
( 12, - 1, a) 146 .451431 
( 14, - l, 3 ( 18 ٤ 
( 16, - ie 3 ) 217.550156 
( 18, - 1 M 255 7 
( 20, - 1 2) 294 „842041 
( 40, - 2, E 6ع‎ 8۶ 
( 40, : 6 ) 621.1958@1 
3 ۹۱۶۱ 3 
( - 1, 12, 1943) 322.457764 
(- 1, 15, 12 ) 289.038574 
( 12, - m D 322.457520 
( IEEE e- d 12 ( 229. 332086 
( 12, 15, = 1 ( 178.622330 
( 15, 2 27%) 178.622332 
( 8, 12, = 1 ) 92.785416 
( 19, - 1 1 ( 118.168716 
( 14, - Dr TES) 182.874771 
( 20, - je 155 296.498291 
(- 1, 1 6 ) 95.293445 


187 





f er we 1 ) 66.218964 
- l, 217 8 ) 338 . 431 36 
( 6, - 1 1 ( د ۶؟‎ . 7 
( 11. = ua 6 ) 95.092933 
4. ITERATION 4 
( 6, Te 6 ) 146.091446 
( 20, 7-7 263,5€4941 
=. ic, 4, 6 ) 281.805176 
(- 6, 20, 6 ) 435.876953 
(- 6, 11 6) 275.054688 
( 6, 14, - 7) 206.950 363 
( 1,- 8, 6 ) 28, 758789 
(- 19, 1ο. 6 ) 567.54174P 
5. ITERATION 5 
( 37 E,- 1 ) 482. 0419504 
( 360, 62, - 1.) 1335.237891 
( 64, - 8, 1 ( 1166 4 
( - 599, 590, 6 ) 1789668. 200206 
( 36, - €, wW) 731 .30€641 
( 266, - 60, 1 ) 2584.00429^ 
( 640, - 82, TED 2574.547363 
( eð, g,- 1) 42 . 6 
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APPENDIX D TEST DATA FROM CASE STUDY 4 





A. SAMPLE DATA 


1. CASE 1 
Class 1 Class 2 
EE UA 4) (ae 19, 21 ) 
EU 2) ( 20, 21, 19 ) 
ο S 4) ) 22 qo. MW ) 
sree, 4 ) ) 22 19, 18 ) 
(6, 6, 2 ) ( 20, 20, 24 ) 
ar 5, 0) (πο 19, 18.) 
a 3.2) ( 22, 22, 19 ) 
ux 3 2) ) 21, 21, 18 ( 
IE 2, 5 ) ( 26, 21, 21 ) 
EN S. 4 ) ( 19, 21, 1? ) 
53,1) ) 21, 15, 29 ( 
(3, 2, 8 ) ( 15. 39, 23 ) 
2. CASE 2 
Class 1 Class 2 
( 9, 6, 5 ) ) 14 2 2) 
arce + ) τε 9ؤ‎ ) 
(2,5, 6) ) 20, 17, 15 ( 
ar 6 ) ( 28, 17, 16 ) 
ENS US. 4 ) ( 18, 18, 24 ) 
) 6, 7, 2 ( ( 15, 17, 16 ) 
COTS x) ( 18, 28, 17 ) 
(ee 5, 4 ) ( 15, 15, ie ) 
(7 4, "7 ) ($24 MS. HO) 
) 9, 7, 6 ( (στο 159, 15 ) 
(NEP 5,53 ) ( 19, 21, 6 ) 
(5, 4, 10) ( 16, 19, 22 ) 


199 





مہ مہ مک ασ”... "Ὁ ο‏ به اه ےن ټل 


عب یه سا ص رب ښښه هده پد تښ ۷ ره ره سم 


5 ط0۸5 2۳۰۰ 


Class 1 Class 2 
iJ 8, 7 ) "2.5. 17 
3 ο, 6ه‎ ( ( 16, 17, 15 
6, 8, 8 ) ISE 15, 13 
9. 6,8) (EUR ادن‎ 14 
19,19, 6 ) ( 16, 16, 22 
8,9, 4 ) (159896. 14 
8, 7,6) ( 16, 18, 15 
10, 7, 6 ) (170m. 14 
9, 6,9) 6 ؛‎ 317. 17 
1.9, 8) ۰ 15 
ο. 7,5) 1 12 E) 14 
6,12 ) ( 16, 17, 9 
4. CASE 4 
Class 1 Class 2 
mo, 10, 9 ) ) 16, 13, 5 
me 9, 8) Ü 1494515. 15 
8, O, 19 ) ) 16 1171 
11, 8, 12 ) (169—135. 12 
me, 12, 8 ) ) دم‎ 6 
10, 11, 6) e 
10, 9, 8) ( 14, 16, 13 
12, 9, 8) ( 15, 15, 12 
کت‎ 8, 11 ) (20 ME, 15 
1,12) (ee 
mee ےو‎ 7 ) 0+. 15 
9, B, 14 ) ( 14, 15, 18 
5. CASE 5 
Class 1 Class 2 
1 1», 11 ) 0 8,8, 35 
13, 11, 16 ( ) 12, 131 
m, 11, 12 ) 14, O 
15, 10, 12 ) ims. MIO 
14, 14, 10 ) ( 12, de» 18 
5, 8.) ( 9, 11, 10 
12, 11, 10 ) I2. I TI 
14, 11, 10 ) (15, 15. 12 
ο. 10, 18 ) ( 18, 18$ 13 
6, 13, 12 ) (11, 13, Ὁ 
11. Ὁ ) ( 13, 15, 12 
I1 ND. 16 ) (12, E. 16 


"کس gin, yin,‏ سا پس وص سا سا کی لا aum, u‏ سم Y ο΄“ ὄν, κο. in, yin, gy, qu,‏ مس وص پوس 


Y Ts ss ss gil, gin, gin, gn, 





I2 


0.093977 
- 1863597 
«29866 
«043806 
«054925 
«014655 
«029114 
. 837278 
«046866 


«01 6088 
. 129569 
019915 
. 7 
. 2020086 
25.971529 


«0158041 
9 
ھ٤6۴‎ 
. 25 
.254499 
.916451 
.285192 


.014684 
.g14588 
«0914609 
«ες 
«021412 
«014696 


.21458" 
.014592 
. 014592 
. 0142 
. 014620 


سیه کت essi‏ یه ته ښوا ته یں لا سے“ ے ےہ anat uerus‏ ےہ A A A AE AA A P A‏ 


ausi وره‎ a? “ea? "apar? اګ ده‎ 


ου.” -”.‏ که را 


REFERENCE POINT TEST 


REFERENCE POINT 


42 
125 


77 


999 
300 


999 
999 


125 
250 
190 


999 
999 
909 


25 
67 
75 
35 
27 
49 


66 
65 
69 
61 
99 


TM 


CASE 1 

a. Iteration 1 
( - ول‎ 42, 
( 42, E 1. 
“= Ue 57, 
(m τι. 47, 
( TUR σα, 
( "T, TT. 
( l27, = 127, 
( = ". ET ©, 
( ον το, ES 6 

b. Iteration 2 
( 999, 999, 
( 999, 999, 
( 5989, 509, 
( 5909, 509, 
( 529, 502, 
( 580, 599, 

ο. Iteration 3 
( 125, 125, 
( 250, 250, 
(- T, 199, 
( 509, 500, 
( m 99S, J 999, 
( - 999, - 999, 
( 590, - 502, 

d. Iteration 4 


55, 55, 
67, 67, 
73, 73, 
33, 33, 
27, 27, 
49, 49, 


Iteration 5 


66, 66, 
63, 63, 
69, 69, 
61, 61, 
59, 59, 


پس Y IA‏ کل نن 


پس پس HI‏ یسے پر 


1 


B. 





«014646 


«127064 
. 186843 
043058 
. 288665 
. 098961 
Jeno 1. 
Ὅς 
.051549 
0804489 


. 1422986 
‚247452 
0226735 
. 047993 
. 438988 
109 21 237 


.027149 
. 827073 
«Wer ils 
5 
.254905 
.827575 


~ 227869 
-027066 
«0ο 7085 
227073 
827087 
«12 


.24 2905 


7 


1.25 


EA 
P lu d 


999 
1 
5 0 
1 
999 


95 
67 
73 
33 
2 
49 


ee”‏ یه aei‏ ای يک مک 


66 
63 
69 
61 
22 
97 


112 


590, 920, -999 


( 57١ 50 


e. GASE 2 


a. tora tion 1 


( P 1, 42, 
( 42, E: وا‎ 
ο ο 57, 
( ۸ 1, 47, 
( 77; 7 
( ("mm nm 
( - 127, - 127, 
( E Tuc O, 
E E ح-ح‎ 6, 
b. Iteration 2 
( 999, 999, 
( 999, 999, 
( 500, 500, 
( 500, 520, 
SOC, 906, 


ο. Iteration 3 


( 555 ο, 
( 6”, 6”, 
( "mu 73; 
( Son 33, 
( 27, 27, 
( 49, 49, 


d. Iteration 4 


( 66, 66, 
( E3, 63, 
( 69, 69, 
( 61, 61, 
( 59, 59, 
( 5 د‎ 


$. CASE 3 
a. Iteration 1 


(- d. 42, 





.405588 
. 291247 
«192559 
le9e20 
061253 
297261 
. 298916 
1727960 


. 063691 
.912851 
.064511 
.265192 
. 102021 
‚102297 
. 062995 


«064561 
.060896 
. G65 
6ء‎ 
‚2621354 
. 11 
.085405 


«061242 
-COLIS 
. 1164 
.062224 
«249189 
«04091778 
. 6065 
. 06952 


.£6€459 
248069 
.BAYESE 
8472382 
. 209695 
‚122499 
. 158638 
. 1 4 
. 297 1200 


eras "uas easi a? e?” a? ΒΡ nasi يه وه‎ πω اص ې سن‎ ο πω AA اس‎ Nu كس‎ 


eet س‎ e ρω 


999, 999 
999 ,-999 
999,-999 
Ίου, 


999, 
189, 


کر کے ہے ہے 


900, 
66, 
65, 
50, 

450, 

450, 

Ry 


O O 


Mere Oe 


4 


183, 
180, 
183, 
180,- 
189,- 39 
180,- 33 
180, 1 
flay, 1 


S 


999 ,-999 
9090,—150 
180,- 99 
540,- 99 
55, 535 
152, 902 


=C = 40 


ο ص۶‎ 
ο τ € 


42, - 
1, 
l, 

DOM 

77, 

- 127, - 

- ΙΖ 

= 73, - 


aum, u u IO" ος ος 


Iteration 


999, 

999, 

ص .ت99 = 
m 1, -‏ 
- ,999 - 
- ,999 
- ,30 


Iteration 


- 153, - 
ος, 
65, 

- 180, - 

- 78, - 
75, 
26, 


Iteration 


= 30, - 
- 27, - 
= 27, - 
= 38, - 
= 36, - 
oo S 
o0, = 
= 30, - 


ووسے پس ټک سے ہے ο‏ ہی اص ے سے 


Iteration 


- ina = 
— 1E, - 
= 33, - 
= 99, - 

189, 

920, 
=- "TEJ, 
L 19, - 
= 15, - 


> پیکے سے‎ NI 


یکسے یکھکھے ہیسے۔ ہوکسے سے یکسی سر پر يسر 


EE 


1 





- 128, - 29, 5) . 200673 
- 126, - 2,- 5) .178624 


4. CASE 4 


a. Iteration 1 


( - ie 42, 1 ( ‚712316 
( 42, - 1, 1) 1.297319 
( - ie 57, 42 ) ‚287248 
( - Te 47, 125 ) 656628 
( ος πη; رہہ‎ . +6 
( .و‎ (pe ee .214881 
( - 127, - 127, 3) ‚331711 
(- : ١ - © 1 ( ‚257414 
( - کو‎ 6,- 1) .618422 
b. Iteration 2 
(- S£, - 186, 1.) «194982 
( 999, 999, 999 ) .220502 
(- 999, - 999, 0 ( ‚352891 
(- 999, - 999, 1 ( ‚353415 
( - 999, - 999,- 1) „352478 
( 999, 999, 0 ( ‚363832 
( - 150, - 900, E ‚208534 
(- 150, - 90@,- 1 ) 207464 
( 66, 66, 66 ) ‚214384 
( 63, 63, 63 ) .214271 
(, 59, 59, 59) 217 
( 57, cu لوو‎ .214122 
( 61, 61, 61 ) ‚214298 
( 67, 67, 67 ) 214425 
ο Iteration 5 
( - 40, - 242, 1 ) .197993 
(- 48, - 248, 12 ) ‚182372 
(- 40, - 249, Q ) .1964 9 
(- Εξ, - 300, ϱ ) . 198964 
( - 50, - 380, 59 ( 201546 
(- 20, - 120, u) ‚191929 
(- 28, = 120,- 5) ‚178492 
(- 30, - 1 ) ‚195347 
(- 30, - 178, Q ) .192591 
d. Iteration 4 
(- 159, - 909,-900 ) .219152 


114 





. 136 7 
«1585551 


. 193407 


4ه . 


. 6 


.190221 
. 182952 
798054 


ΞΕ 


0237442 


«1390267 
28; 
„455872 


216891 
.546129 


‚555944 


. 165547 


‚590564 


.622728 


. 4335392 


«5647 66 
82291 


‚159882 


429952 


.621341 


484715« 
130225 
459282‚ 
>۶ 8۹ء 
647579« 
441676« 
1187021 
413536. 
458988 


.136481 
. 360885 


Le 
38 


21 
1 
15 


Se 


e 
یا ی ی حر یہ رن ہی‎ 


Cn OQ Cn Oi آیا ۱ا یہ‎ ), Cn 


e œ 


(- 150, - 900,-150 ) 
(- 23, - 188,- 99 ) 
(- 99, - 549,- 99 ) 
( 180, oe, 335 ) 
( 920, 150, 909 ) 
(- 1€2, - 960,- 43 ) 
( - 19,- 60,- 2) 
CASE 5 
a. Iteration 1 
( - 1, 42, 1 ( 
( 42, - 1, 1 ( 
( - 1E 57, 42 ) 
(- 15 47, 125 ) 
( جو و‎ 1 ) 
( ۶۴ U E 
(= 127, = 127, 3 ( 
M De ος, 1 
(- 73, - 6,- 1 ) 
b. Iteration 2 
( - 159, - 999, Tai) 
(- οφ, = 180, TuS) 
(- "5, = 450, TD 
( 2, 10911,7008 ) 
( Qe 86, 63 ) 
(- 1. 234, 168 ) 
( - 150, - 9900, Q ) 
C. Iteration 3 
(- 40, - 240, 1) 
(- 40, - 249,- 19 ) 
(- 40, - 240, Q ) 
(- 58, - 300, 0 ( 
(- 58, - 308, 50) 
(- 28, - 128, 1) 
(- وع‎ - 128,- 5) 
(- S9, - 190, 1) 
(- 30, - 179, 2) 
d. Iteration 4 
(- 150, - 900,-900 ) 
(- 150, - 900,-150 ) 


113 





5.401924 
3.531217 
297551578 
38.826274 
0.247082 
36۔5 
66.094223 
97.096405 


116 


55, 


99, 
180, 
906, 
TCU. 


128, 
120, 


au, VU, سر وک پمسے وکس‎ rm, ptm 





يپ 


Eu d‏ يه u‏ ره رګ ه u‏ ه که په خر په د 


په ې ده ي۷ يره ست“ په خر ۷ څل په eA‏ ضر په ييک ot”‏ هه تیه خو لي په 


OnNPPHAPAMNNIP NAA NMR ες, 


I^ 
- 


ο = e -+ ® + ο = * ο e © -+ ο بد‎ 3 


ONGA|A AGAR PPO‏ بح مر ھم مم حم 


BOE 
IG 
19, 
17, 
16 
20, 
16, 
16, 
18, 
B 
ic, 
15, 
16, 
P 
18, 
16, 


ο 


کا MN‏ ت0 (0 0ه ټایئ ص) ن۸ ص) رص) څ مش خڅ خڅ MOP‏ 


= *1 « *1 په + = 9 c9‏ نو چا ο‏ » © $ = 


15, 
14, 
16, 
15, 
15, 
16, 
18, 
16, 
s 
gd 
1 
T 
16, 
16, 
17, 
18, 


® 


ON‏ ی جر رہ ی یی i COO! r‏ ہر ټ- ۸ ټر) مر ج) 


= o ο τ 9 o — . 9 o = « ο ο - بر‎ 


ier 
15, 
14, 
E 
14, 
15, 
19, 
16, 
16, 
16, 
19, 
1 
18, 
16, 
15, 
16, 


fD 


ο 


QN IPS | POI Οἳ Ην HOY HIP Im HI» HOO [n 
DP POP POP P WOOD خر زی‎ rt 


© + ο © -+ v 9o 9 Ὁ 1* “Ου ο $ » e 


19, 19; 
16, 15, 


Eo. qe, 
ar. 15. 
29%. 19% 
15, 17% 
ron, 17: 
Q5 3٦ 
و15‎ 15, 
15% 15 
ο 1; 
ο, τσ. 
14, 16, 
0 
17, TE, 


PI? 


e ο ο ΕΠΟΝ CASE STUTT 5 


A 
. 


DA A OA A μ»‏ جر نہ O‏ صی جر مر 


ο 4 4 4 e $ ور 9 ور پل‎ 9 9o Ὁ ^. ο لر‎ 


16, 
16, 
15, 
15, 
18, 
16, 
17, 
| 
ο. 
17, 
16, 
ee 
13, 
16, 
18, 
18, 


E 


O 
* 


ο ® 9‏ ایح «Ου 9 © + © ο‏ * +- +- € په 


, C1 On Y i» O4 (Dh Oy) i» i On O1 Od (n CR 


APPENDIX 


SAMPLE DATA 


CASE 1 

(Ma. 20 
( S. ©, 
( a4, 4, 
( ولا‎ ©, 
( 5. ۰ 
( E Ye 
( S53 4, 
( کوت‎ αν 
( 2 ον 
( a m 
( 4 => 
( 4, 5, 
( S MES 
( = D 
( a, 2, 
( [uS 2, 
( E ON. 
( 16, 12, 
CIT IRE, 
τ. 15, 
( 0 
( 16, 16, 
(MEN ETE 
( 12, 16. 
( 16, 15, 
TRIG, 16; 
(EID EIS. 
۲1... 
۴,31, 
Gel 
( 18, 14, 
ISA 
( 13, 16, 


A. 
L 


Class 1 


Class 2 





ca? "ct "ct "ca ca "ct ct? ct?” at ct‏ هده at at‏ ےہ ےہ 


سے۔ صسے- صص- صبےہ صسےہ صہ صہ A A‏ صہ صےہ A‏ 


QO OQ O OQ fF OO OF OM O)‏ مې 


15 
14 
15 
14 
10 
14 
12 
16 
1 
15 
14 
15 
15 
14 
14 
Fe 


OYO حم‎ N NP ONO OOOO Mo O 


1" ο ο + و‎ » $ e ο πο ο * و‎ = > 


15, 
14, 
τ 
14, 
12, 
14, 


IL, 
14, 
15, 
as, 
14, 
14, 
16, 
mF, 
14, 
14, 


O11 000 00 ی‎ O) O) t O) Oi CA On 


1" + - 9 * v» x + E > πο e ο + = 


Ir 
14, 
qas. 
16, 
17 
16, 
ii, 
1 
13, 
15, 
11. 
14, 
15. 
15, 
a. 
14, 


PP OOP NVM ANN OO Pf YO 


- uv» «9 بي‎ © + "v 9 < + بر‎ ο o -+ 


pes, 
15, 
17, 
14, 
15, 
13, 
le. 
17, 
15, 
jn 
T 
15, 
کل‎ 
14, 
16, 
14, 


هم 
زج NAW OA‏ 009 ې صل ١‏ ١٥ص‏ )0 ټ- هن 0۱ ما ٥00‏ بت 
O OO OO OO O O O N (FN O OM OO‏ 


15, Je 
im, 15, 
sh, 12, 
15, 16, 
15, 12, 
ja 15 
15, 17, 
14, 15, 
15, 12, 
on. tee, 
a wm 
و لا‎ 18, 
18 14, 
te. 15, 
13, 16, 
13, 5 


Ο) فا ئا حص)‎ 010100000 i i NOM O 


+ + +% + eo y Ὁ y Ὁ ow «9 y په ته‎ y «9 


15, 
14, 
18, 
15, 
15, 
m, 
iz, 
15, 
16, 
12, 
ás, 
13, 
12, 
"E, 
er 


OY S9 45 O1 O) OY O1 O) 3 0Ο 00 Οὐ Ην Η 


= το © ο ο — ο + Ὁ 9 + + وی‎ + -+ 


14, 
14, 
13, 
14, 
14, 
12 
o 
13, 
125 
jb. 
12, 
le, 
14, 
14 
τα. 
ir, 


هم 
PHM N‏ ټ- () یئ 0 ټ) () ټ(- ول - Q3 O) X‏ 


ο ο © +v یح‎ ο. بو‎ + WY «9 © + v -+ + 


0ے 
,16 
,16 
,15 
,15 
l5,‏ 
,15 
,13 
,12 
,16 
,14 
,12 
,12 
,16 
,2 
,17 


CASE 2 


Cn مھ جر رہم یہ نہ نی‎ OQ OF O FM O CN ¢ 


»> په oo «9 y‏ يت «Ὁ‏ «9« ې يې ته . Y‏ 4 - 


ae 
16, 
12, 
IM 
14, 
flee 
1 
τα. 
14, 
18, 
14, 
ier 
17, 
16, 
τα. 
14, 


بے rrr‏ پس urn me, Ur, Sume, fr OO pn, Gf, fn, ln rr e,‏ شر 


Gr A, کل سر پر پوس پو سر پر سر وکس پس سے تښ سي‎ ης 


2 


Class 1 


Class 2 





bc ULL.‏ خڅ ده و ده و په 


Wen‏ په کر مه hl. u ο ο ου Bu u at?‏ غه رن هه ره 


مم هم 


هم 
MOAN‏ (0) 03505000000 


12 
14 
12 
15 
1 
1é 
14 
ls 
1 
15 
12 
15 
12 
12 
12 
11 


O) A O0 00 O) '$ (0 OD NODA O O ہہ یہ‎ 


- - وه‎ ο «ῷ u ο 3 E - * b ο * * 


122 
r2, 
11, 
14, 
1 و‎ 
I 
Iu 


و ڼ 1 
Tue‏ 
ز11 
ME‏ 
TES‏ 
,14 
ا 
;12 


هم 


هر هم 
OO OD‏ 0 ښ) ΟΡΟΦΟ ώς‏ 


8 1 یه‎ ο ο * ο + جحد‎ + + * + * $ 


15% 


ES. 
18, 


121 
12. 
i 
13, 
1 ن‎ 
14, 
15, 
15, 
1 
13, 
16, 


on 
14, 
14, 
12, 
11, 
12, 


15, 
10, 
ize 
1 
17. 
14, 
Mi 
12, 
er 


I 


pa 


pa 
0003139003230 AN 


ο * E ο + ο د‎ a ο «Ὁ ο ο ο * -+ 


۰ 
V 9 


13, 
19, 
16, 
1 
14, 
12, 
14, 
1s. 
IR, 
12, 
12, 
11 
in 
12, 


12, 


,12 
,13 
کت 
,12 
,15 
.15 
1 
1 
1 


12. 
12 
128 
15, 


119 


HH 
و 0 یہ و0‎ «0 -2-29090»000000 00 ο 


ο 


® ο © + + یب‎ . ο © + 


ie 
15. 
12, 
16, 
12. 
1% 
13, 
12, 
11 
13, 
10, 
12, 
14%, 


تل 1 
,14 


πο 
Ίος 
19, 
14, 


18, 
12, 


2 
و پا 


1 
1, 
14, 
vo, 


19, 
14, 


Y 00 


Do 
Ζ 
- 

το. 

10, 

12, 

0 

11 

12, 

1 

Toy 

14 

15, 

15. 

13, 

13, 

13 


CASE 3 


ه۲م 
® 


* 


هم هم 
OD‏ رح یہ عر رق بر 0( 2- 00 2- «D «4D £O OD (OO‏ 


$ -ῳ > + = ا‎ ο €" + ο ο 


τς, 
IN 
ro, 
Dos 
T 
125 
D 
le; 
14, 
ο, 


Ίος 
per, 
12, 
1 ور‎ 
14, 


ar A, ertt. ume, UA" پس سر‎ ur Supe, qur, A GA IU" IT مر‎ 


Um 


Class 1 


Class 2 





ecu o a u ا‎ a ري‎ a? ga? A Nu ul u u u ΒΡ» 


Bad وڅ په يا‎ u په‎ u ضر‎ u EP LLL ee” 


19 
12 
19 
10 
10 
10 


16 
10 


I 


12 
19 
14 
11 
12 


1 
12 
14 


12 
17 


10 


10 
15 
12 
17 


ΠΠ 


10, 


το 
"5 


15, 
18, 
ولا‎ 
dul. 


L2, 
Doe 
12, 
(7 
19, 
12, 
15, 


12, 


1ο. 
12, 


12, 


1١ ΤΊ, 
14, 9, 
9, 10, 
512٦ 
101 ۰۰ 
9, 10, 
8, 13, 
AS 
197 .:8, 
1١ 1 
νυ .1Ξ, 
nS dee 
9, 12, 
12 8, 
12, 9, 
7, 1C, 
و‎ 1! 
19, 10, 
το τς, 
πα, οἱ. 
15, 16, 
9, 16, 
12, 10, 
Srl 
11 Ἠ.τς.. 
198 1, 
12 l, 
8, 9, 
10, 10, 
9, 7, 
10, 9, 


120 


To; 
18, 


18, 
10% 


id. 
19, 


19, 
19, 
ο 
19, 
19, 
ως 
16, 


IT, 


12, 


14, 
Lo 
12, 


CASE 4 


arr tm. OR LO Gf m نس سر پل سر‎ 


Class 1 


Class 2 





00451 . 
2859734 
285882 
004654 ~ 
4ھ 


.2 9 
. 934534 
«055966 
ΞΕ 
. 52695 


.065248 
278378 
Woo 
062027 
806 


4259557 
.204590 
"062271 
. 66 
765 


20 
ee 


21 
17 


صا اوي δω ων ο‏ خد u‏ خر يه رر له 


ὃν‏ ېږ پک يګ ρω‏ خښ 


ED) 
500) 
-64, -65, -66) 
-501,-592,-503,-504,-505,-5906,-507,-508,—-5209,-512? 

0,-721,-821,-921,-111,-211,-211,-411,-511,-611? 


EJ 
3006 


ο ο, 


26377۰ و 


REFERENCE POINT TEST 


REFERENCE POINT 


1 


S 
186 


οσο σος 
ioo. 2425; 


CASE 1 

a. Iteration 
Oe. IO. 54, 
σος 155. 115. 


HS 


5l, 
Ml, 


Ret وم ےہ و اک وب‎ = Cl, = تر يي‎ 65,- 64,— 65,- ٤ 
E015-5902,—525,—-504,—505,—506,—-527,-508,-509.—512 
ELI ze ,—-Oee,-lil,—2i,—oll ,-411,-511,-611 


2 cO. εὐ 


; "E65. 290,502 


1 


2 
Zee 


Sio. Os 
120, 2M, 


CASE 2 
a. Iteration 


24, 
75, 


>, 
182, 


Sz. 
171, 


0ے 


E, 


121, 


etiam 66ب وو اک‎ - CE, 62,— 65,— €4,—- 65,- 66 
Eu z02,-5005—5044-7505,—506,-507,-508,—-F.09,—-510 
2-921 ,—-1101,—211,—511, 241 1,—-511,-2611 


29,77 
402 ,298 
6ح 53.6 


58 


ο οσο, 


1 


co, SEL 7 
125, 245, 289 


CASE ὃ 

a. Iteration 
Be, "Se, 54, 
lw 182, 175, 


3 


9 


Sls 


El, 


UEM τν στ 096 ہے‎ 08, EN, 62,— 65,- 


ΤΙ -508,-508,-584.,-5065,-506,-50ΐ7, -508,-509,-510 
Ec cHN-O540,—920,-111,.-2W,-091,- 1 2584 ,—€11 


,39 و598 
a55, 298,‏ 


CASE 4 


oO 
286, 
26۰ 


on 
125; 7 
s50} =66 ,==C], 


Iteratior 1 


54, 
195, 


29, 
Eee, 


d. 


I2, 
EM. 
38, 


SAN, 
12 
-57,. 


mes‏ سخ IU" GU‏ ني Y > a E a Y‏ سي پر کي 


A ο PESA پک‎ κ, 





147816 
12.298581 
IZ ۹ 
9.707917 
1221229023 
19.077774 
ء2‎ 47 
18 ۶ 
1 7٦ 
Si T 
SEL 
1026275095 
9.724404 
12.710549 
2ک و‎ 5689 
17 42 
11.579161 
12.225653 
10.217498 
9.311914 
9.743191 
13.919784 
9.724404 
T4 959551] 
13.270512 
16:72 
102222622 
8.751494 
1564 .4435 
32 0 2 
409 .654962 
15.521062 
2067 
21.259661 


ED 
E 
) 


2 


b. Iteration 


El ο ο 90,311, -411,-511,-611) 
B2 oa Ns -990.-511,-411,-511,-611) 


Q,-411,-511, -1) 
902, 999,-411,-511, -1) 
sgg) 


3 


C. Iteration 


lI 2-1 ,2z2l,- 111,998,‏ 
دد اي 
مطللک5-, 11 -,!1ن- ده لالح ,اا وت ,2-1 gi‏ 


21,73591, 21 


-1,-821 ,-421,-111, 9@@,-211,-411 ,-511,-611) 
-1,-221,-921,-111, 922,-311,-411,-511,-€11) 


999,-311,-411,-511,-611) 
990,-311,-411,-511,-€11) 
900,-999,-411,-511,-611) 
922,-€66,-411,-511,-411) 
9090,-211,-411,-511,-611? 


908,-311,-411,-511,-611) 
984 ,-666,-411,-511,-611) 
998 ,-999,-411,-511,-611) 
900,-999,-411,-511,-€11) 


900,-999,-411,-511,-611) 
900,-999,-411,-511,-€11) 
992,-222,-411,-511,-611) 
990,-999,-411,-511,-6€11) 
900,-311,-411,-999,-€11) 
989,-311,-411, 1,-611) 
909,-311,-411, 500,-611) 
988,-999,-411,-511,-611) 


90@,-999 ,-411 ,-511 ,-611) 
920,-311,-411,-511,-€11) 
990,-999,-411,-511,-6€11) 
900,-411,-411,-511,-611) 
900 ,-311,-411 ,-511 ,-999) 
992,-999,-411,-511,-999) 
900,-999,-999,-511,-999) 


122 


4 


IIL, 
Sl G1, O21, =I, 
ll, 
Saal, 
= LIE, 


A 


ur 


.مم 
Sale,‏ 
EI,‏ 
SET‏ 


6 


απ. 
πο ος. 
ο. 
I CDS 
S; PIS 
ج,‎ ۰ 
"p M 
η]. 


7 


yo ele 
πμ. 
srl: 
ΙΙ» 
VOUS 
"τμ 
ο”. 


dao Iteration 
-1,-821,-999 


meu , 1‏ 
21 زح را دت وات 
21 تح ence‏ 


e. Iteration 


ile, و1 ص-‎ 
ms cem 
1,284 ,-219 
2,8210, οἱ 


f. Iteration 


200,821 ,-921 
G0 =B821,-219 
ΕΕ], “521 
لت‎ ΕΕ -Ο:Ι 
ΙΕ: -9el 
-1, 2821, 921 
oi, seed ,-921 
πα ος =ar 


€. Iteration 


8€0,-£21,-921 
-1, 999,-921 
-1, 999,-921 
809, 999,-921 
-1,-821,-921 
820, 999,-921 
800, 999,-921 


Es ocu -201,—511,—411,-511, 
دی لچ‎ 9x I —1.—511,—-411,—-511, 
E: SS zer, -511,-411,-511,-E1l 


دی يی 299 So‏ 


ο و نو‎ 9% 9 ο ο + 


يک زي e e‏ ت e‏ تی 


- ο 9 9 Ὁ wo Ὁ 


> Y Y a E انس‎ 


مکسے et‏ سي کت تي ων ga‏ 





899, 999,-921,-111, 9200,-999, 500,-511,-999) 158.365446 
S00, 999, -021, -111, 969, -999 , 999,-511,-999) 11577.5690 
800, 999,-921,-111, 9990,-999, Ich 2999 MEC 2 Sage? 


203, 999,-921,-111, 922,-999,-522,-511,-999) 49.597549 
h. Iteration & 
820,-821,-921,-111, 920,-999,-411,-511,-611) 8.751494 
820,-821,-219,-111, 900,-999,-411,-511,-€11) 8.468982 
-1,-821,-921,-111, 900,-311,-411,-511,-611) 11.772139 
-—1,-821,-921,-111, 922,-311,-411,-511,-611) 11.542337 
800,—-821,-219,-111, 900,-999,-411,-511,-611) 8.294548 
822 ,-821,-216,-555, 900€,-999,-411,-511,-611) 9.677239 
E90,-821,-219, 555, 292,-999,-411,-511,-511) 9.24635 


123 


سر )سر تت تر ېسر پک سر 





۶ي ا تبه dl‏ يټ ېه تر په یه ميه رس ها یلا 


AAA‏ یک ,, d‏ هه يه ریه څيه يه يل 


260 
Zoe 
262 
260 
264 
213 
259 
264 
299 
259 
e 
23 
259 
259 
259 
259 


260 
2 
zen 
260 
262 
260 
261 
260 
26% 
260 
261 
269 
268 
260 
21 
260 


Bek, 
260, 
209; 
260, 
aou, 
252, 
239, 
260, 
239, 
Zee, 
2093 
239, 
Be, 
ano, 
239, 
269, 


200, 
299, 
23), 
ΕΞ, 
59, 
299, 
260, 
GER, 
299, 
BER, 
= 
298, 
Bae. 
EDO. 
259, 
292, 


260, 
229%, 
Zac, 
260, 
26 13, 
262, 
260, 
269, 
269; 
59, 
229, 
SEN, 
“ου, 
26l; 
col, 
و251‎ 


PIE 
21 
252, 
2.80, 
ZOU, 
209; 
2C0, 
262, 
بت2‎ 
262; 
26 
262; 
gol, 
ze], 
C2, 
BC, 


LOZ 
cE, 
Dez, 
2o] 
202, 
269, 
260, 
EU 
ου. 
260, 
261, 
221 
260, 
269, 
260, 
Bei, 


262, 
2616; 
262; 
poc 
2102, 
262, 
οσα, 
ZOL, 
E 
pog; 
259, 
239, 
za, 
260, 
299; 
269, 


FROM CASE STUDY € 


f, 


205, 
eel, 
202, 
2er, 
20 
262, 
262 
205; 
265, 
239, 
eL c 
262, 
ὅσα, 
26€, 
262, 
Ber, 


263, 
263, 
265, 
262, 
263, 
263, 
265, 
264, 
267, 
264, 
265, 
264, 
262, 
263, 
264, 
262, 
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e, 


298, 
264, 
264, 
eS 
268, 
264, 
COE 
2035 
20, 
267 
2605, 
20 
ΞΕ». 
264, 
264, 
200% 


263% 
2097; 
209; 
2694 
266% 
264, 
26 
264, 
2033 
264, 
264, 
265, 
268, 
2765 
265, 
264, 


d, 


2E, 
264, 
205, 
266; 
2 ٦ 
266, 
zm 
200; 
264, 
265; 
266; 
ZOO, 
por 
eco; 
209, 
285. 


27 
2 
2687 
285, 
ΕΕ, 
206; 
2608, 
206; 
21 
270, 
CN 
σας 
206, 
ADO, 
205; 
ΞΕ, 


C, 


259, 
ہا ے2‎ 
al, 
259, 
Zar, 
20 
zu, 
ες, 
ہ25‎ 
265, 
264, 
Zou, 
264, 
οσο, 
Econ 
αι. 


239, 
240, 
244, 
269, 
EI 
270, 
239, 
ΤΙ. 
234, 
257, 
235, 
238, 
240, 
227, 
234, 
272, 


APPENDIX F TEST DATA 


A. SAMPLE DATA 


PHASE 1 

O 
4, 124, 
13, 200, 
19, 230, 
2, 225, 
198, 101, 
ےت‎ 
16, 227, 
O 
39, 233, 
32, 231, 
lo EOD 
2€, 229, 
29, 232, 
DI MOST. 
16, 227, 
JM 
E 
191 115, 
19, 225, 
6, 225, 
1I 
2,422, 
الو‎ 
5. 1ο, 
19, 226, 
32, 282, 
Se, 232, 
2%, 281, 
34, 235, 
16, 228, 
15, 227, 
32, 233, 


πα æA 


IT" PP IT" IC ΤῸΝ PA AA PTA SODA, A ITA PA یکھے‎ ο δρυ 


2 


Y Ts تر پس تر پس کت تی پس تس‎ σσ σης ο ως 


دول 


Class 


Class 





dl d ee”‏ که A wu‏ یه کس يګ رت 


261 
265 
ZOE 
262 
261 
ΞΕ 
269 
262 
262 
202 
202 
26% 
Zee 
260 
202 
zen] 


261; 
260, 
2605 
261, 
262, 
264, 
263, 
264, 
6۰ھ‎ 
299, 
Doc 
2 ٦ 
(ΕΙ. 
οσο, 
262, 
zer, 


CA 


O 
264, 
264, 
264, 
264, 
265, 
265, 
260; 
266, 
266E, 
Fer, 
65; 
265; 
261, 
ceo, 
200, 


54. 596 
185.349 
259.638 
245:9 
264.459 
264.849 
2653 959 
Cl 685 
261.584 
261.399 


265, 
264, 
263, 
263, 
263, 
263, 
264, 
264, 
261, 
261, 
261, 
264, 
266, 
266, 
267, 
266, 


26 
265, 
IS a 
265, 
266, 
26٦ 
Zee, 
266, 
Ze 
260, 
209, 
265, 
264, 
264, 
205, 
ον 


DES T 


77 223۶ و277 
62 م23 το.‏ 
Zn 722,269,‏ 
emo,‏ ,2909 ,252 
oO D 271‏ 
o, COO, 271,‏ 
,269 ,254 ,251 
,299 ,201 ,00 
,269 ,255 ,284 
Ber, 28458267,‏ 
;266 ,29 ,6 
2657 26 ,226 
ZEW gooey 266,‏ 
RS 266,‏ +226 
ELMO y BEA,‏ 
pog οτι 264,‏ 
SAMPLE‏ 421 : 


28, 119, 
20, 116, 
29, 122, 
31,123, 
35, 124, 
49, ?25, 
7. 
40, 226, 
or, ite. 
23, 122, 
0+ τη. 
15, 104, 

ee 

1, 86, 

a 
191, 78, 

PHASE 2 


Class 3 


Read each class mean as a column vector. 


class 


Z 


49.766 
188.725 
242.222 
265.637 
264 .482 
265.552 
26172 
260.693 
260.258 
262.295 
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121.479 
135.914 
240.907 
26 6 
264.964 
«ος. τει 
251.6 
266.564 
56 
Ες 


600 1 


u PON MO د هم‎ oO ت‎ 





5 


Some 


934778 


995774 


«214196 


2055998 


7ء 


«469596 


. £53402 


9995 


-9999 


-9999 


29939 


29999 


Ei 


DIESES 


-9999 


-9999 


REFERENCE POINT TEST 


REFERENCE POINT 
M48 SWMPLE qST 
a. TIteratiom TI 
9999, 9999, 9999, 9999, 9999, 
9999, 9999, 9999, 9999, 
-9999, -9999, -9999, -9999, -9999, 
E: 9999, -9999, -9999, -9999, 
-50900, -9999, -9999, -9999, -9999, 
zo, SISSI -9999, 7933593, 
-1002, -9999, -9999, -9999, -9999, 
-9999, -9999, -$999, -9999, 
- 500, -9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
@, -9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
750, -9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
3222, -9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
7000, -9999, -9999, -9999, -9999, 


-9999, -9999, -9999, -9999, 


b. ITERATION 2 


—-5600, -9999, -9999, -9999, -9999, 


ES 





00 MI 
ω ΙΙΙ 
TL Zi ἰ nd 
| τν. 





. 86 


.Q" 5095 


.982452 


. 990015 


.998687 


. 0186© 


. 0 


9784E9 


1 


4 


.991259 


.99711E 


-9999, -9999, -9999, -9999, -9999 
-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 
-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 
-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 
-0999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 
-9999, -9999, -9999, -9999, 


-9999, “9999, “9999, “9999, -9999 


c. ITERATION 3 


SO IS ب9090‎ 7 

-9999, -9999, -9999, -9999, -9999 
το ο πο ον τι δν, 3385, 

-9999, -9999, -9999, -9999, -9999 
9999, 792999, =9999, =9999, 

-9999, -9999, -9999, -9999, -9999 
-9999, 098p, πο ο, ۰, 

πο ον ο ο, πο ο, 79999, -9999 
πο ο, -3939, «0999, 7353, 

-9999, -9999, ~9999, -9999, -9999 
-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 


Iv 


-2200, 


#309, 


-1299 , 


- 990, 


> 702, 





. 207870 


. 4 


. 668 


. 0 


Πε 


3107452 


«9844070 


270370 


«54002 


DA 


956ھ 


.952154 


I 


I 


36 


-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
ITERATION 4 
-5090, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
-1990, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
- 592, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
9, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
759, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
3020, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
7000, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
-5ρ00, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 
-1202, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, -9999 ) 


= eve, us له )دنه‎ 
-9999, -9999, -9999, -9999, -9999 ) 

2 ۷0000 το”, 
-9999, -9999, -9999, -9999, -9999 ) 


128 


-4400 , 


Edo, 


-9999, 


-9999, 


-9999, 


22229, 


-3000 , 


— 3202, 


-5900, 


- 000 76 





۳۷ بھی 
24.588181 


82.097099 


0.949582 
0.925911 
0.901211 
2.876356 
61115 
0.1 
۷ . 26 7 


0.785749 


) 


) 


-9999 


=9999 


-9999 


79999 


-9999 


-9999 


-9999 


=9999 


-9999 


-- 5-5 


-9999 


750, -9999, -9999, -9999, 


-9999 , 


ο 


-9999, -9999, -9999, 


-9999, 


----», 


SEDO, 


79999; =9999; =9999; -9999, 


το 


m 


-9999, 


-9999, 


2 3 


799995 


7220, 


209999 9935, 


5 


ITERATION 


799997 9999; 


-9500 


-9999, —9999, -9999, -9999, 


-9999, -9999, -9999, 
SS) 
EJ E 
Bu 


-9999, 


-9090, 


ὄν 55, 


2 


-9999, 


—8 500% 


-9999, -9999, -9999, 


7-993 99995 


52 
-9999, 
Es 
-99397 
29999, 
EU 
-9999, 
-6000, -9999, -9999, -9999, 
5: 


,ےہ 


3935 


-9999, 


299993 


-9995, 


-9999, 


129 


5 کي 


-8g00, 


29999, 729999; 


-9999, -9999, 


-7 300, 


49/0099 999999; 


-99907 


-7000 , -9999, 
-—9999, -9999, 
οσους, =9999, 


OUS 


-9999, -9999, 


-9999, 


-99909 , 


ΛΔ 


-9999, 


٢.د‏ د هي 


e. 


-3000, 


-۔- 


-5020, 


2 2 


-3200, 


-5008 , 


٤ا‏ ٹی۔ 


- 


-3202 , 


-30800 , 


- 


-502 , 





«68541 


۰۶۷5 


. 747554 


6ءء 


“78026 


.821493 


‚847168 


‚878674 


956938 


4069589 


TADS 


) 


-9999 


=9999 


09 کچ" 


55 


-9999 


E 


-9999 


-9999 


9و - 


رج 


-9999 


ο το ο, τος, -9990, 


-3000, -4500, -9999, -9999, -9999 


29999, =9999, 9999, 9999, 


-5020, -4000, -9999, -9999, -9999, 


9999, -9999, -9999, -9999, 


eee TER AT TOO 


-5000, -600, -9999, -9999, -9999, 


ο -۲ 9990 ۰39096 ۰۰, 


-3220, -3220, -9999, -9999, -9999, 


9999, -9999, -9999, -9999, 


-90600, -28¢2, -9999, -9999, -9999, 


=9999 , 9999, =9999, =9, 


-3800, -2400, -9999, -9999, -9999, 


HINA πο το ο, ποσο, 


-5000, -2200, -9999, -9999, -9999, 


-9999, -9999, -9999, -9999, 


-53222 , -1802, -9999, -9999, -9999, 


-9999, -9999, -9999, -9999, 


-$000, -1400, -9999, -9999, -9999, 


πο πι οσο ۹ 7۰ 


g. ITERATION 7 


ο ο, που, “τοσα, -9999, -9999, 


-9999, -9999, -9999, -9999, 


150 





«026672 


«41066566 


.048544 


992999 


07.1219 


26172 


.467827 


.87- 2 


79ھ" 


. 9 


#825657 


د1 . 


200199 


CA 


m 


-9999 


-9999 


-9999 


-9999 


-9999 


-9999 


-9999 


-9999 


99099 


430909 


-9999 


=90999 


oe mJ 79999, 


9ے و وو ت6 6 ۷ تدج 


Δ ΙΙ 999, 


SSI SO SI ISS ESOO O, 


-9999, 44000, -9999, -9999, 


-OSSO, πο ο, 733, 41, 


-9999, 8608, 9999, -9999, 


-9999, -9999, -9999, -9999, 


-9999, -7002, -9999, -9999, 


-2999, -9999, -9999, -9999, 


-9939, -5000, -9999, -9999, 


-9999, —9999, -3999, -9999, 


-9999, - IM وووو۔‎ -9999, 


-9999, -9999, -9999, -9999, 


-9999, 4298, -9999, -9999, 


“9099, 399890, —99099, -9999, 


-4500, 80072, -9999, -9999, 


-9999, -9999, -9999, -9999, 


-4300, 770906, —9999, -9999, 


-9999, -9999, -9999, -9999, 


-4522, -3202, -9999, -9999, 


-9999, -9999, -9999, -9999, 


T4590, = ما‎ 38749۰۲-۰ 


39990 -9999 -9900:, -—9980, 


-4500, 409090, -9999, -9999, 


-9999, -9999, -9999, -9999, 


151 


--. 


E3599. 


-9999 ¥ 


-9999, 


- ۱, 


-5020, 


-5299 , 


-3090, 


238009 


-3000 , 


-5008 , 


-5809 , 





4.224475 


172 02 


1.954675 


24171665 


2.450296 


2 5 1 


2.957519 


6.274505 


5.919746 


4.616714 


3999 


-9999 


ug 


-9999 


-9999 


-9999 


-9999 


-9999 


- 9 


-9999 


-9995 


-9999 


Eg 
29999, 


-9999, 
-9999, 


OS, 


ITERATION 8 


8922, 


-45989, 
29999. 


-4500, -9999, -"7000, -9999, 


-9999, -9999, -9999, -9999, 


-3999, 


-9999, 


a 50009-9998 


9000, 


-9999, 


>0 9٦ت‎ 
1200, -9999, 
B 
ΞΕ 
ngog eg. 
220€, -9999, 
-90 9999; 
4000, -9999, 
2995311099995 
C000, -9999, 
-9999, -9999, 


8200, -9999, 


Emo 


-9999, 


BJ 


zoo E 


- 0 
-9999, 
ἘΠΕ, 
وو‎ 


0 -۔ 


-9999, -9999, -9999, 


-4590 , 


999۹۹9۹ 


-9999, 


-9999 , 


-9999, 


-9999, 


-9995, 


-9999 , 


-9999, 


-4500, 


-9999, 


-45009, 
-9999, 
-4500, 
ο 


-4500, 


-9999, -9999, -9999, -9999, 


-9999, 
-9999, 


-9999, -7002, -9999, 


-92090, 
τ 


-9999, 


το... 


-9999, 
-4500, 


h. 


-5000, 


۱ -۔- 


- ۱ 


-502 6 


٤‏ -۔ 


-5002, 


-500€, 


-3200, 


-3200, 


-520C , 


-5200, - ۰7 


-3000, 





19 


1.554962 


1956525 


1.559961 


1 ک۶٤‎ 


1O6 


11 


1.952010756 


1.545766 


1526925 


1.509349 


231 


T 
00 


RO 


η 


-9999 


-9999 


-9999 


-9999 


-9999 


ΤΕ 


-9999 


-9999 


-9999 


-9999 


=9999, 


999, 


STO, 


E 


-9999, -5000, 


-9999. 


-9999, 


-45909, 


-9999, -9999, -9999, -9999, 


999, 


η 


=3000, 


ο, 


-4500, 


-9999, -9999, -9999, -9999, 


-9999, -1002, -9999, 


-9999, 


Bd 


-9999, 


ول 


-4520, 


-9999, -9999, 


-4506, 


-9999, -9999, -9999, -9999, 


999, 


m 


2000, 


ποσο σα 


-4500, 


-9999, -9999, -9999, -9999, 


42000, -9999, 


099, 


=9999, 


-4500, 


-9999, -9999, -9999, 


8280, -9999, 


-9999, 


ο 
79099, 


9995 


-9999 


-4500 , 


=9999, =9999, —9999, 


=9 


-9999, 


-9999, 


E 


-9999, -9999, 


ITERATION 9 


-9999,, 


E 


1. 


-9999, 
~9000 , 


- 229, 


-7220, -9999, -9999, -9999, 


-9899, -9999, 


-9999, 


-O9BO. 


-5000, -9999, -9999, -9999, 


-9999, -9999, -9999, -9999, 


OSO 


-9999, 


135 


-9999, 


-3000 , 


-5200 , 


-3208 , 


-3292, 


-5022, 


-3022, 


-5200, 


-9999, 


29999, 





. 477160 


468720 


.437694 
«422596 
407ES 

- 544096 
νο: ον 
.3112 
.495849 
.481759 
.474153 


. 459345 


=9995 


ο ο. 


-9999 


-9999 


ΔΒ 


29999 


SOS 


و 


-9999 


-9999 


-9999 


-9999 


2999 


1,999999, 59999, 


29000,9999, "39899, 


m 9009, ug. -9999, 


-1098, -9999, -9999, -9999, 


0999, 299909 ο ο, “9999, 


,9 0 تت5 1۲۰۴9 = 


29300, 555.55, -95586, 


CGO, ο ος, 29299, -9999, 


ο Egg 5-5. 


4220, -9999, -9999, -9999, 


STO SENSIS) OG, O00, 


ISS E 29993 


=9999, -9999, -9999, -9999, 


ο cO 229955 


=9999, -9999, -9999, “9999, 


-9999, -9992, -9999, -9999, 


ISSO 9999, σσ ο, 


T2999, <7002 "29999, =3999, 


-9999, -9999, -9999, -9999, 


>0, 090, A 


που σος, -9999, -9999 , 3395, 


-9999, -3090, -9999, -9999, 


-09907 GE, O9, -9999; 


9ی۷۷ 9977009 0> 


-9999, -9999, -9999, -9999, 
-9999, - 
-9999, -9999, -9999, -9999, 
-9999, 


134 


-9999 , 


E9999, 


-9999, 


-9999, 


R99, 


-9999, 


-9999, 


- ο, 


22799, 


-9999, 


9999, 





-9999, -9999, -9999, -9999, -9999, 

-9999, 4000, -9999, -9999, -9999 ) 1.445719 
-9999, -9999, -9999, -9999, -9999, 

-9999, 6000, -9999, -9999, -9999 ) 1.431514 
-9999, -9999, -9999, -9999, -9999, 

-9999, 6009, -9999, -9999, -9999 ) 1.418290 
-9999, -9999, -9999, -9999, -9999, 

-9999, -9999, -9?900, -9999, -9999 ) 1.542633 
-9999, -9999, -9999, -9999, -9999, 

-9999, -9999, -70€00, -9999, -9999 ) 1.520531 
-9999, -9999, -9999, -9999, -9999, 

-9999, -9999, -53øð, -9999, -9999 ) 1.484761 


j- ITERATION 12 
| 

-9999, -9999, -9999, -9999, -9999, 

-9999, -9999, - 1, -9999, -9999 ) 1.477756 
-9999, -9999, -9999, -9999, -9999, 

-9999, -9999, 20900, -9999, -9999 ) 1.464212 
-9999, -9999, -9999, -9999, -9999, 

5ه 1 ) 9999- ,9999- ,4000 ,9999- ,9999- 
,9999- ,9999- ,9999- ,9999- ,9999- 

-9999, -9999, 6000, -9999, -9999 ) 1.437445 
-9999, -9999, -9999, -9999, -9999, 

-9999, -9999, 8000, -9999, -9999 ) 1.424325 


m OSOS, 79323939, -0909, -OO999, 





7081ء 


‚552997 


71 


‚527595 


.495237 


‚429655 


4780ES 


.466519 


.455645 


«444107 


. 0 


«998848 


.551022 


-9999 


το 


-9999 


-9999 


-9999 


-9999 


-9999 


-9999 


-9999 


-9999 


-9020 


- 00 


-5 0 


-9999, -9999, -9999, -9090, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -7900, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -5999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -3900, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -1090, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, - 1, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -3999, 2020, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, 4222, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999,  €900, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, 8090, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 
-9999, -9999, -9999, -9999, 


29939, 73299, 739339, -9999, 


1356 


299995 


-9959, 


-9999, 


79999, 


-9999, 


-9999, 


-0999, 


-9999, 


29999, 


-9999, 


-9999, 


ο 32337 


-9999, 





IEG 


‚519691 


«902452 


.&94842 


. 4869027 


. 0084 


.&422€9 


747745 


.5 1999/9 


72ء 


«2866949 


-9999, -9999, -9999, -9999, -5222 
-9999, -9999, 9999, 9999, 

ο ο R9999, =9999, -1339 
-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, - D 
-9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, 2000 
-9999, -9999, -9999, -9999, -9999, 

-9909, -9999, -9999, -9999, 4028 
-9999, -9999, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, 6090 
-9999, -9999, -9999, -9999, -9999, 


-0999, -9999, -9999, -9999, 80820 


ITERATION 11 


-4500, -9999, -9999, -9999, 

9999, 9999, 9999, 9999, 9999 
-4520, -9999, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 
-4&500, -"200, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 
-45090, -'7500, -9999, -9999, 

-9999, -9999, -9999, -9999, -9999 
-4500, -8200, -9999, -9999, 


-9999, -9999, -9999, -9999, -9999 
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-9999, 


-9999, 


-9999, 


-9999, 


-9999, 


-9999, 


۰۱ -۔- 


20400, 


-5200, 


-5200, 


-3220, 





( -3000, -4520, -7008, -9999, -9999, 

9999, 9999, 9999, 9999, 9999 ) 90.452415 
( -3000, -4500, -7009, -9999, -9999, 

99999, 99999, 99999, 99999, 99999 ) 18655559 


2. 421 SAMPLE TEST 
a. ITERATION 1 
( -3200, -4500, -7209, -9999, -9999, 
99999, 99999, 99999, 99999, 99999 ) 13+8۶ 
( -3000. -4500, -7090,-99999,-99999, 
99999, 99999, 99999, 99999, 99999 ) 1.510979 
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Read each mean as a 


ὁ 


34.296 
185.549 
259.630 
ص9 و‎ 
264,459 
254.849 
265.959 
2015585 
261.584 
26 5 
262.572 
259.870 
259.689 
ئ2‎ ٤ 
293 5 
259.214 
29 1 
2581907 
29822 
258178 
258.164 
2585129 
258.221 
29ے‎ 221 
2977629 
250.088 
2> 
eom] 
LIO? 
297.479 
cO O 
29 5 


class 
2 


49.766 
1062725 
242.022 
26 7 
٤6/7 
265.350 
26172 
269.693 
260.258 
260.099 
2992328 
259.075 
ZOE. SoC 
σος 6, 
6ء‎ S 
25867235 
258.306 
257.963 
258.044 
ο ο 
2 0 eo 
COT 6 
του 9 
257.343 
κος οσο 


2397729 


220.239 
ae) 
29.35 
me 
29 ٦ 
Zot ο” 
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APLEENDIX.C DESI DAT FROM CASE STUDY 7 


A SAMPLE DATA 


The class means only are provided. 


column vector. 


1 


121.279 
133.914 
240.907 
266.378 
264.9€4 
۶26 104 
261.77 
2€2.564 
260.586 
259.082 
259.6393 
58.356 
258.828 
2 1 
258.456 
58.518 
2980.139 
258.100 
1.878 
2 6 
257.764 
ى2‎ 2008 
297.002 
2, 1 
257.414 
257.545 
257.105 
237.200 
28 0 το 
2537.17 
2527.28 
230.092 


vector 
component 


NT RO ENT HESS gern HDD OH IH ف پان بب ېچ‎ )0 σω 





B. REFERENCE POINT DATA 

Read each reference point as a column vector. The value 
of a vector component across a row remain constant unless 
indicated otherwise. The last component value change to 
occur remains in effect until modified. The resulting 


(I ) is shown below the corresponding vector. 


"۰۱۹۱ ھ۹‎ TION 1 
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m. :‏ زاو د د -Z000‏ 3 

b -4508 Tm» NT 7 ۰ 

τ -7 282 د و‎ e ; : 

d -9999 3 eO : : 

e -9999 NO ۸ : 

B 99999 "n. SE : 

g 99999 7 : AS. I 

h 99999 7 me. 

1 9999 99999 2 9999 

j 9999 99999 AN 9999 x 

k 9999 -9999 99999 9999 99999 

99999 9999 99999 9999- وووو 1 

m 9999 A : 99999 -9999 

n 9999 n : 8 -99999 

0 وووو‎ , sae x -99999 

p 9999 m $a 8 -99999 

q 9999 " m 99999 99999 

r 9999 0 Um 99999 99999 

5 9999 A 2293 -9999 99999 

t 9999 zd ος -9999 99999 

u 9999 απ. a -9999 99999 

۷ وووو‎ 28 Be -9999 -99999 

W 9999 T N -9999 -99999 

1 9999 7 . -9999 -99999 

y 9999 um .. -9999 99999 

7 وووو‎ S "c -9999 99999 

+ 9999 ες 7 -9999 99999 

Q 9999 ο - -9999 99999 

# 9999 7 ᾿ -9999 99999 

$ 9999 0 : -9999 -99999 

Z 9999 - : -9999 -99999 

& 9999 1 -9999 -99999 
1.€83572 1.844750 3.736396 1.896465 54.177185 





7920 


1 


5222 


1.7 060 
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ITERATION 2 


-2303 


1.748494 


- 506 
-4520 
-7 00 0 
-9999 
-9999 
99999 
99999 
99999 
99999 
99999 
-6 0 
-9999 
-9999 
-9999 
m 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
E 
-9999 
-9999 
-9999 
-9999 


1.828800 


e. 


f^ 3Q-U* 3E Ὁ Jt € *4 م‎ € < Ff ct ہا‎ HO 'd O B 3 rmm x ce. σύ trm fooc tnm 





E. MERATION 3 


- 0 

- 42 06 S cu ε.α τ. 

-7 000 ο». ... D 

-9999 55 ... ... 

-9999 ... sc sha DE 
99999 درد .ده‎ To ... 
99999 ده‎ ae a .. 
99999 ... ... n sce 
99999 ... ... s nc 
99999 AST د‎ n ..- 
-9999 T τη ese ene 
-6202 -2 0 3200 7292 -9999 
29999 E ... oc e090 
-9999 Sole ne ا‎ IE 
-9999 Soe πος n ... 
=9999 2 ... ως 


-9999 ... دنه‎ oc . 
-9999 د‎ ... ٠ ٠ 
-9999 ... u 1 . 
-9999 T ec .. . 
-9999 ... ... SOC ٠ 
-9999 ده‎ TE . . 
-9999 I ... .. 
-9999 ... و‎ . 
9999 ... . Soc 
T9999 2 e .. 
-9999 ο ο . . 
-9999 ... . 


5599 I ده‎ ... oc 
-9999 So) so, ده‎ ... 
-9999 ... nc cee ace 
SOS T S n T 


1.825965 1.772686 1.854467 1.785567 1.821434 
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CRAD X t M KK < £j et م م م پلژ عم ے چم نم بح 3 هن اص‎ oD 





1.754914 


9 Φ 
9 9 
9 
e © 
999 
9 
* e 
ο 
* e 
e 9 
© © 


20999 
-6009 


1.82297 


7020 


1.799887 


1435 


ITERATION 4 


1.882494 


-3 240 
-45 00 
-7 000 
-9999 
-9999 
99999 
99999 
99999 
99999 


99999 
-9999 
29009 
-2 0 
-9999 
=9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
5 
-9999 
-9999 
3 
-9999 


1.763998 


4. 


هوی ټم م مت وی ٢م‏ حم یچ ىم ο 5 ZB‏ اص ص جے عم په Q^» 39-* dt (Qo Xt NW X‏ 





1.868520 


eee 
© è o 
6© © ¢ 
eee 
با‎ è o 
eo 
949 
e è è 
© © ο 
eee 
ما‎ © e 
eee 
99 9 
+ è o 
-2000 
eee 
... 
eee 
eee 
© © o 
© © ο 
eee 
999 
eee 
eee 
© © e 
© © è 
eee 
e © o 
© © @ 


1.762524 


© © è 
999 
© © 9 
نر © ما‎ 
99 9 
999 
© © o 
999 


-9999 
-6000 


9 99 
لر نر با 
999 
لر نر ما 
o‏ © © 
ο‏ © © 
99 9 
ο 9‏ 
© © © 
9 99 
9 99 
9 949 


949 9 


999 


1.802555 


ITERATION 5 


999 
eee 
99 9 
999 
999 
© © è 
© © d e 
e o © 
© © ¢ 
. 9 e 
© © è 
© © ه‎ 


. 9 e 


7000 
0 پچ 


9499 


1.762995 


-502% 
-4500 
-" 000 
-9999 
-9999 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
29999 
20600 
-9999 
5 
-9999 
-9999 
-9999 
2950809 
-9999 
29069 
=9 999 
-9999 
-9999 
-9999 
-9999 
3999 
-9999 
-9999 
-9999 
-9999 


1.816526 


5, 


یم ی و نہ وچ و Oo D 3 (m Ic. DU‏ کا ص وپ ہا £ بې € M‏ با dE C‏ نہ E‏ صمح DP‏ 





27021032 


-2000 3009 
1.758676 1.803582 
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ITERATION 6 


-9999 
-6000 


1.789922 


-3000 
-4580 
-? 0900 
-9999 
-9999 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
-9999 
-9999 
7207 
-9999 
-9999 
وووو۔‎ 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
=9999 
Ἢ 
-9999 
39999 
-9999 
Ὁ 
-9999 


1.793651 


6. 


DR RO X “4 KK <“ صا بپ یم‎ +H Ord O dd )ام پان ۶ئ حم »)ېرونم تت‎ ao gt 





7008 


1.764592 


5000 


1.898782 
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ITERATION 7 


-2000 


1.022200 


-3 30 0 
-4520 
-7 000 
-9999 
Edd 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-6 0 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
29999 
-9999 
-9999 
-9999 
-9999 
-9999 


1.787084 


n 


Q^a9-u- dt (Q dE N *4 bM X «4 £ ct i HO 'O O D 3 rm Ne. DU) یىی و م هوم‎ v 





- 09 


1. 7 


“1006 


1.706574 
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ITERATION € 


-1508 


1 .764483 


-3000 
-4500 
-7 000 
-9999 
-9999 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-2 000 
-9999 
-9999 
-9999 
29999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
=9999 
-9999 


1.754462 


8. 


Pilar نی ح3‎ ¥N SS HH. € 4 £C er UW MY ODF Pr N IN ID RO oO 0 





= 1 


17211359 


-1200 


1.735211 
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ITERATION 9 


-2000 


1 . 6 


-5000 
-4500 
- 7 00 
5 
-9999 
99999 
99999 
99999 
99999 
99999 
-9999 
-9999 
-9999 
2-980909 
-9999 
-9999 
EE 
-9999 
-3 0 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
-9999 
Joe 
-9999 
-9999 
29999 


15895550 


9. 


MRL KD ENS AW KE بے‎ FC یا‎ Ωω OH Zr nn re DM ID AN Ωω 
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ITERATION 12 


eee 
99 9 
999 
999 
999 
99 9 
© © © 
99 8 
Φ 9 e 


-2009 
-2000 
-2020 
-2000 
-2002 
-2030 
-2000 
-2020 
-2200 
-- 0 
-2000 
-29 40 
-2 000 
-2008 
-2 000 
- 0 
-2000 
=2 009 
-2000 
-2000 
-2000 
-2002 


1.624708 


-303 0 
-4599 
-7 000 
-9999 
PISOS 
99999 
99999 
99999 
99999 
99999 
-1900 
-1000 
-1 0 
-1290 
-1 م۷‎ 
-1 4 
-64 
-1900 
-1022 
-1 060 
-1 0 
-1 0 
-1000 
-1 0 
-1990 
-1-0 
-1 0 
-1028 
-12009 
-1020 
-1 3 
-1 0 


1.644567 


12. 


MQ“ HO NN 5 E <“ FC c* t 0 'rBd o D 3 c وی هم م م ی0ک سم بپ ې‎ 
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